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Abstract 

Cloud-to-ground  (CG)  lightning  is  a  hazard  to  the  Air  Force  for  both  air  and 
ground  operations.  Forecasting  CG  lightning  is  a  necessary  and  extremely  important 
requirement  for  Air  Force  meteorologists  and  forecasters.  The  15th  Operational  Weather 
Squadron  requested  a  forecast  tool  capable  of  predicting  CG  lightning  within  a  25  and  10 
nautical  mile  radius  of  the  13  military  locations  in  their  area  of  responsibility.  To  fulhh 
their  request,  forecast  decision  tools  were  created  using  a  Classification  and  Regression 
Tree  (CART)  data  analysis  program. 

Four  decision  trees  were  produced  for  each  location  using  the  period  of  record 
from  March  through  September,  1993  to  2002.  CART  compared  the  upper  air  stability 
indices  and  surface  data  at  12-hour  intervals  with  CG  lightning  data  occurring  within  the 
next  12  hours  to  determine  prediction  rules.  Data  from  2003  were  used  as  independent 
verification  of  the  decision  trees. 

The  CART  decisions  trees  were  examined  using  contingency  tables  and 
verification  tests  to  determine  the  value  of  the  products  created.  The  straight  forward 
forecast  rules  and  verification  test  results  confirmed  that  the  decision  trees  would  be  a 
valuable  prediction  tool.  Combined  with  forecaster  knowledge,  forecast  models  and 
other  tools,  the  decision  trees  would  provide  an  excellent  forecast  method  for 
determining  the  occurrence  of  CG  lightning.  Therefore,  the  results  are  recommended  to 
the  15th  Operational  Weather  Squadron  for  use  as  a  CG  lightning  forecast  tool. 
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DEVELOPING  A  EORECAST  TOOL  EOR  CLOUD-TO-GROUND  LIGHTNING 


IN  THE  NORTH  CENTRAL  AND  NORTHEAST  UNITED  STATES 


1.  Introduction 

Thunderstorms  are  weather  phenomena  that  affect  the  entire  region  of  North 
America.  A  major  product  of  these  thunderstorms,  cloud-to-ground  (CG)  lightning  is  a 
major  hazard  to  the  weather  and  Air  Eorce  communities.  CG  Lightning  poses  the 
greatest  threat  to  people  and  property  during  the  thunderstorm  season  (NWS  1997).  The 
following  statistics  were  reported  in  a  National  Oceanic  and  Atmospheric  Administration 
(NOAA)  Technical  Memorandum  of  thunderstorm  and  CG  lightning  related  incidents 
reported  from  1959-1994  (NWS  1997).  There  were  3,229  deaths,  9,818  injuries,  and 
19,814  reports  of  property  damage  in  the  United  States.  Young  men  of  age  10-35,  either 
at  work  or  involved  in  recreation,  and  children  accounted  for  85  percent  of  lightning 
victims.  The  highest  density  of  these  incidents  occurred  in  New  England,  the  southeast, 
the  plains,  and  the  Rocky  Mountains  (NWS  1997). 

The  world’s  increasing  dependence  on  technology  and  energy  has  increased  the 
importance  for  the  weather  community  to  achieve  the  ability  to  predict  the  occurrence  of 
thunderstorms  and  CG  lightning  to  help  minimize  the  damage  to  electrical  supply  lines 
and  to  system  technologies.  The  commercial  industry  reported  estimates  totaling  nearly 


This  thesis  follows  the  style  of  the  American  Meteorology  Society  (AMS  2002). 


$385  million  dollars  in  damage  structures  and  electrical  systems  from  1973-1982  (NLSI 
2003).  CG  lightning  can  be  blamed  for  most  of  the  claims  since  it  is  the  single  largest 
cause  of  outages  in  electric  power  distribution  systems  (NLSI  2003). 

The  Department  of  Defense  (DoD)  and  the  Federal  Aviation  Administration 
(FAA)  are  extremely  concerned  with  CG  lightning  due  to  the  risk  to  personnel  and  the 
cost  of  replacing  damaged  equipment.  With  a  single  aircraft  costing  millions  of  dollars, 
the  need  for  better  thunderstorm  and  lightning  warnings  is  becoming  more  crucial  than 
ever.  The  15th  Operational  Weather  Squadron  (OWS)  located  at  Scott  AFB,  Illinois  has 
the  responsibility  of  forecasting  weather  for  two  of  these  critical  regions.  The  15**'  OWS 
issues  forecasts,  watches,  and  warnings  for  12  active  duty  and  17  Reserve  and  National 
Guard  military  installations  across  the  region  shown  in  Fig.  1.  From  March  through 
September  2003,  the  15th  OWS  verified  747  separate  cases  of  CG  lightning  in  their  area 
of  responsibilities  (AOR). 


Fig  1.  The  15*’’  Operational  Weather  Squadron  Area  of  Responsibility  (AOR)  (modified 

from  15”’ OWS  2003). 
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a.  Statement  of  the  Problem 


The  15th  OWS  has  a  need  for  a  reliable  forecast  tool  to  predict  CG  lightning. 
Venzke  (2001)  developed  a  method  to  apply  stability  indices  computed  from  upper  air 
soundings  to  determine  the  probability  of  CG  lightning  for  a  region  within  a  50  nautical- 
mile  (nm)  radius  surrounding  the  upper  air  stations.  This  research  started  with  the  same 
problem  but  will  approach  the  problem  using  different  prediction  tools  and  prediction 
parameters.  The  focus  will  be  placed  on  a  different  region  of  the  U.S.  and  this  study  will 
use  different  location  criteria  in  determining  the  locations  used.  Venzke  (2001)  developed 
predictive  tools  for  CG  lightning  that  could  be  applied  to  the  Midwest  but  for  only 
locations  with  an  upper  air  site  on  location.  The  area  of  interest  for  this  research  will  be 
in  the  North  Central  and  Northeast  U.S.,  not  the  Midwest,  and  the  focus  will  be  on 
locations  geographically  separated  from  the  upper  air  stations,  in  some  cases  by  over  100 
miles.  Forecasters  at  most  military  installations  do  not  have  the  benefit  of  on-site  upper 
air  stations,  therefore  this  research  will  focus  on  using  what  is  available  to  the  military 
operational  forecasters  in  an  effort  to  determine  a  predictor  for  CG  lightning  for  the  radial 
distance  that  is  required  at  each  location.  The  National  Weather  Service  (NWS)  report 
NWS  SR- 193  (1997)  indicated  that  the  critical  time  frame  for  CG  lightning  for  the  North 
Central  and  Northeast  was  centered  on  the  summer  months  during  the  afternoon  hours, 
therefore  this  study  will  focus  on  a  data  set  containing  the  warmer  months. 

The  severity  of  the  thunderstorms  was  not  considered  in  this  research.  This 
research  was  only  concerned  with  the  occurrence  of  CG  lightning.  Frontal  systems  are  a 
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major  concern  when  using  data  from  two  geographically  separated  sources.  The  greatest 
potential  shortfall  of  using  stability  indiees  alone  is  the  possible  difference  between  the 
air  masses  at  the  upper  air  site  and  the  point  of  interest.  Therefore,  surface  data  from 
both  the  upper  air  loeation  and  the  loeation  of  interest  were  compared  and  implemented 
into  the  predietion  process  to  reduee  the  effeets  of  frontal  systems  on  the  deeision  tree. 

b.  Research  Objectives 

One  of  the  goals  for  this  research  was  to  find  a  good,  user  friendly  prediction  tool 
for  CG  lightning  for  each  of  the  locations  in  the  15th  OWS  AOR.  Keeping  this  main 
objective  in  mind,  the  data  criterion  was  to  limit  the  predictors  to  a  list  that  could  easily 
be  created  and  used  by  the  forecaster  in  the  field.  Another  objeetive  was  to  use  the 
predietion  tool  to  foreeast  the  probability  of  lightning  within  two  eategories:  25  nautical 
miles  (nm)  and  10  nm.  The  following  tasks  were  required  to  aehieve  the  forecast 
products  for  each  of  the  North  Central  and  Northeast  US  loeations: 

1 .  Communicate  with  the  15*’^  OWS  to  determine  the  upper  air  loeations  best 
suited  for  use  in  eaeh  of  the  13  locations  within  their  AOR. 

2.  Foeus  on  the  most  critical  time  of  year  for  the  CG  lightning  threat  and 
choose  the  predietors  to  be  used  in  the  data  set. 

3.  Use  Classification  and  Regression  Tree  (CART)  analysis  to  determine  if 

predictive  tools  can  be  formulated  for  eaeh  loeation  of  interest. 
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4.  Apply  CART  to  the  data  set  eontaining  CG  lightning  eounts  and  stability 
indiees  to  determine  a  loeation  dependent  list  of  rules  for  the  oeeurrenee  of 
CG  lightning. 

5.  Create  deeision  tools  based  on  the  findings  from  the  CART  output. 

6.  Use  an  independent  data  set  to  validate  the  deeision  tools. 

This  researeh  eombined  the  knowledge  learned  from  both  Venzke  (2001)  and 
Sahu  and  Singh  (1999)  to  determine  the  best  methods  for  developing  the  CG  lightning 
foreeast  deeision  trees.  CART,  a  new  and  exeiting  statistieal  program,  was  applied  to  the 
proeess  performed  by  Venzke  (2001)  to  develop  a  better  tool  for  foreeasting  CG 
lightning.  Ideas  for  new  predietors  were  taken  from  the  works  of  Sahu  and  Singh  (1999). 
Data  sets  from  Mareh  1993  through  September  2002  were  analyzed  using  CART  to 
develop  deeision  trees  for  the  prediction  of  CG  lightning.  The  decision  trees  were 
validated  using  independent  data  from  March  through  September  2003. 

Chapter  2  provides  a  background  discussion  for  the  study.  Previous  studies  on 
lightning  and  stability  indices  were  used  to  discover  the  important  findings  from  other 
authors.  Chapter  3  focuses  on  the  sources  of  the  data  sets  and  the  methodology  used  to 
formulate  the  research  results.  Chapter  4  discusses  the  results  found  using  the  CART 
analysis  program.  Decision  tools  and  forecast  rules  are  provided  for  future  use  by  the 
15*  OWS.  The  final  chapter  summarizes  the  research  and  discusses  the  importance  of 
the  results  to  the  field  of  meteorology  and  to  the  mission  of  the  15*  OWS. 
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2.  Literature  Review 


a.  Lightning 


Thunderstorms  are  of  major  eoneern  to  the  aviation  and  business 
eommunities.  Lightning  diseharges  ean  oeeur  as  inter-eloud,  eloud-to-eloud,  eloud-to- 
air,  and  eloud-to-ground.  A  top  weather  eoneern,  CG  lightning  ean  kill,  destroy 
equipment,  start  fires,  and  disturb  power  deliveries  systems.  The  National  Oeeanie  and 
Atmospherie  Administration  (NOAA)  performed  a  study  on  the  effeets  of  CG  lightning 
aeross  the  United  States.  The  NOAA  Teehnieal  Memorandum  (NWS  1997)  summarized 
damage,  injuries,  and  deaths  resulting  from  lightning  in  the  United  States  from  1959- 
1994.  The  variability  of  lightning-eaused  reports  was  less  than  any  other  weather  event 
during  this  period;  therefore,  people  are  vulnerable  to  CG  lightning  throughout  the  entire 
thunderstorm  season.  People  involved  in  reereation,  loeated  around  trees,  or  loeated 
elose  to  bodies  of  water  were  the  three  largest  eategories  of  lightning  fatalities.  A 
statistieal  eomparison  of  all  weather  phenomena  lists  CG  lightning  as  the  seeond  leading 
eause  of  weather  related  deaths  behind  the  eombined  eategory  of  flash  and  river  flood 
related  deaths.  Table  1  shows  the  top  ten  loeations  for  deaths,  injuries,  and  damage 
reported  for  the  period  1959-1994. 
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Table  1.  Top  ten  states  for  lightning  caused  deaths,  injuries,  and  damage.  The  states  in 
bold  are  located  within  the  15‘*'  OWS  AOR  (modified  from  NWS  SR-193  1997). 


Number 

Number 

Number 

of 

Damage 

Reports 

Rank 

Deaths 

of 

Deaths 

Injuries 

of 

Injuries 

Damage 

1 

Florida 

345 

Florida 

1178 

Pennsylvania 

1441 

2 

North 

Carolina 

165 

Michigan 

643 

Kansas 

1182 

3 

Texas 

164 

Pennsylvania 

535 

New  York 

1005 

4 

New  York 

128 

North  Carolina 

464 

North 

Carolina 

960 

5 

Tennessee 

124 

New  York 

449 

Oklahoma 

826 

6 

Louisiana 

116 

Ohio 

430 

Michigan 

814 

7 

Maryland 

116 

Tennessee 

349 

Tennessee 

764 

8 

Ohio 

115 

Texas 

334 

South 

Carolina 

717 

9 

Arkansas 

110 

Massachusetts 

331 

Texas 

689 

10 

Pennsylvania 

109 

Georgia 

329 

Georgia 

656 

1)  NATIONAL  LIGHTNING  DETECTION  NETWORK  (NLDN) 


Eorecasters  verified  thunderstorms  through  three  main  processes:  I)  using 
satellite  data,  which  were  thirty  minutes  or  older,  2)  using  radar  data,  which  were  several 
minutes  to  thirty  minutes  old,  and  3)  using  the  weather  observations  which  were  station 
dependent,  so  if  thunderstorms  were  not  in  the  vicinity  of  a  reporting  station,  they  were 
not  reported.  The  timeliness  of  data  available  to  weather  forecasters  demonstrated  the 
need  of  a  near  time  reporting  system  for  thunderstorms.  A  device  to  detect  CG  lightning 
would  also  be  beneficial  for  issuing  thunderstorm  warnings  to  protect  people  at  large 
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outdoor  events  or  engaged  in  sporting  aetivities.  The  National  Lightning  Deteetion 
Network  (NLDN)  was  ereated  in  1988  to  provide  near  real  time  data  and  arehived  data  to 
those  with  a  eoneem  for  CG  lightning.  The  loeation  aecuraey  of  the  system  was  8  to  16 
km  with  a  first  stroke  flash  detection  efficiency  of  70%.  In  1992,  GeoMet  Data  Services 
(GDS),  the  company  that  maintained  the  NLDN,  calibrated  the  sensors  to  increase  the 
location  accuracy  to  4  to  8  km,  and  the  first  stroke  flash  detection  efficiency  was  also 
improved  to  65  to  80%.  A  major  upgrade  to  the  lightning  detection  system  was 
completed  in  1995.  This  upgrade  improved  the  location  accuracy  to  1  to  2  km  and 
increased  the  first  stroke  flash  detection  efficiency  to  80  to  90%.  Video  verification 
showed  detection  efficiencies  at  84%  prior  to  the  upgrade  in  1994  and  85%  after  the 
upgrade  in  1995.  However,  the  NLDN  detects  only  cloud-to-ground  lightning,  therefore 
thunderstorm  forecasts  using  this  method  were  limited  since  a  thunderstorm  might  only 
produce  the  undetectable  intracloud  lightning  (Huffmes  and  Orville  1999). 

Wacker  and  Orville  (1999a)  analyzed  the  CG  lightning  data  after  the  upgrade  of 
1994  to  determine  the  benefits  and  results  of  the  upgrade.  The  1994  upgrade  had  three 
major  goals:  use  the  IMPACT  (improved  performance  through  combined  technology) 
system  standards  to  improve  location  accuracy,  increase  detection  efficiency,  and 
enhance  the  reliability  of  the  NLDN  hardware.  Wacker  and  Orville  (1999b)  concluded 
that  the  number  of  detected  weak  flashes  of  CG  lightning  increased  after  the  upgrade, 
therefore  the  total  number  of  detected  CG  lightning  increased.  And,  since  the  total 
number  of  strong  flashes  remained  constant,  the  mean  peak  current  actually  decreased  for 
detected  flashes.  A  major  result  of  the  upgrade  was  that  decreasing  the  pulse  width 
detection  criterion  improved  the  NLDN  but  it  also  included  an  unwanted  contamination 


of  intra-cloud  flashes  (Wacker  and  Orville  1999b).  A  more  complete  discussion  on  the 
NLDN  and  the  upgrade  can  be  found  in  Wacker  and  Orville  (1999  a,b)  and  Cummins  et 
al.  (1998). 

Global  Atmospherics  Inc.  (GAI),  the  company  that  currently  maintains  the 
NLDN,  elaims  the  system  has  a  loeation  aceuracy  of  500  meters  and  a  deteetion 
probability  between  80-90  pereent,  whieh  varies  slightly  depending  on  region.  One  third 
of  all  lightning  flashes  contain  strokes  that  strike  the  ground  in  different  locations 
(GHRC  2003).  Researchers  defined  a  single  flash  as  all  discharges  within  10  km  and  a 
one  second  interval  (GHRC  2003). 

The  IMPACT  system  deteets  and  groups  all  strokes  from  each  flash.  The 
lightning  data  contains  the  number  of  strokes  per  flash,  time  and  location  of  flash,  and 
peak  signal  amplitude.  A  major  weather  benefit  of  NLDN  lightning  data  is  that  the  strike 
loeations  can  be  determined  in  about  30  seeonds.  The  data  were  available  24  hours  a  day, 
everyday  of  the  year,  and  every  lightning  event  is  quality  controlled  to  ensure  aecuraey. 

2)  APPLICATIONS  OF  NLDN  DATA 

The  NLDN  data  set  contains  a  continuous  record  of  CG  lightning  across  the 
continental  United  States  extending  200-300  km  off  the  coastline.  These  data  provide  a 
eontinuous  data  set  dating  from  January  1,  1988  through  the  present.  The  NLDN  data 
were  used  by  National  Weather  Service,  Federal  Aviation  Administration,  The  Weather 
Channel,  PGA,  major  power  companies,  international  and  regional  airports,  and  many 
businesses  nationwide  (Lightning  Storm  2003). 
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The  data  also  provided  an  exeellent  CG  lightning  researeh  tool  sinee,  for  the  first 


time,  total  area  coverage  was  available  instead  of  station  dependent  data.  Huffines  and 
Orville  (1999)  calculated  the  lightning  ground  flash  density  and  thunderstorm  duration 
for  the  Continental  United  States.  They  demonstrated  that  for  the  period  from  1989  thru 
1996,  the  Midwest  region  and  the  Atlantic  Seaboard  are  two  of  the  three  maximums  for 
CG  lightning  mean  annual  flash  rate.  Orville  and  Huffines  (2001)  again  summarized  CG 
lightning,  but  this  time  they  used  data  for  the  decade  1989-1998.  They  again  observed  a 
very  high  density  of  CG  lightning  throughout  the  Midwest.  To  show  the  true  value  of  a 
total  coverage  lightning  detection  system,  Orville  et  al.  (2002),  focusing  on  the  years 
1998-2000,  expanded  the  CG  lightning  study  to  include  Canada  and  termed  the  combined 
detection  system  the  North  American  Lightning  Detection  Network  (NALDN).The  CG 
lightning  densities  from  all  three  results  had  two  maximums  in  the  regions  monitored  by 
the  15  th  OWS. 


b.  Stability 

As  discussed  earlier,  lightning  is  very  important  to  the  Department  of  Defense  and 
the  civilian  sector  in  terms  of  safety  and  property  damage.  The  thunderstorms  that 
produced  this  lightning  required  three  critical  elements  for  development:  moisture,  a 
trigger  mechanism,  and  an  atmosphere  that  is  conditionally  unstable.  This  section  will 
focus  on  the  need  for  a  conditionally  unstable  atmosphere  for  thunderstorm  development. 
Stability  will  be  used  as  a  prediction  tool  for  determining  the  probability  of  lightning. 

The  weather  community  uses  several  terms  to  describe  the  condition  of  the  troposphere  in 
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terms  of  static  stability:  conditional  instability,  absolute  instability  (or  stability)  and 
convective  instability.  A  brief  description  follows;  however,  for  a  more  detailed 
discussion  of  stability,  see  Huschke  (1959). 

Static  stability  is  a  measure  of  the  instability  of  the  atmosphere  and  is  a  key 
requirement  for  thunderstorm  development.  Static  stability  is  the  measure  of  the  stability 
of  an  atmosphere  defined  to  be  in  hydrostatic  equilibrium  to  vertical  displacements 
(Huschke,  1959).  Holton  (1992)  described  static  stability  by  using  the  dry  adiabatic  lapse 
rate  and  the  atmospheric  lapse  rate.  He  stated  the  dry  adiabatic  lapse  rate  can  be  found  in 
an  atmosphere  where  potential  temperature  is  constant  with  height.  If  the  potential 
temperature  increases  with  height,  then  the  atmospheric  lapse  rate  is  less  than  the 
adiabatic  lapse  rate.  The  parcel,  when  adiabatically  displaced  from  its  equilibrium  level, 
will  be  positively  buoyant  when  displaced  downward  and  will  be  negatively  buoyant 
when  displaced  upward.  The  parcel  will  return  to  its  original  location  to  maintain 
hydrostatic  equilibrium. 

The  stability  of  the  atmosphere  can  be  determined  by  comparing  the  lapse  rate 
with  the  adiabatic  lapse  rate.  The  lapse  rate  is  defined  as  the  change  in  temperature  with 
respect  to  pressure  or  height  (Holton  1992).  If  the  parcel  is  unsaturated,  the  comparison 
is  made  between  the  dry  adiabatic  lapse  rate  and  the  environmental  lapse  rate.  The  dry 
adiabatic  lapse  rate  is  calculated  to  be  approximately  10°C  km'\ 

Moisture  in  the  atmosphere  adds  a  complicating  factor  to  the  forecasting  of  the 
stability  process.  Conditional  instability  is  defined  as  the  of  stability  for  the  atmosphere 
in  which  the  lapse  rate  is  less  than  dry-adiabatic  lapse  rate  but  greater  than  the  saturation 
adiabatic  lapse  rate  (Wallace  and  Hobbs,  1977).  The  saturation  adiabatic  lapse  rate  is  to 
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be  approximately  6.5°C  km‘\  The  atmosphere  is  unstable  for  the  saturated  parcel  and  the 
parcel  if  lifted  adiabatically  will  displace  vertically  upward.  However  if  the  parcel  is 
unsaturated,  the  adiabatically  lifted  parcel  will  return  to  its  previous  level. 

Absolute  stability  and  absolute  instability  are  two  terms  used  to  describe  the 
comparison  between  the  lapse  rate  and  the  dry  adiabatic  lapse  rate.  An  absolutely 
unstable  atmosphere  has  a  lapse  rate  greater  than  the  dry  adiabatic  lapse  rate.  Therefore, 
if  the  parcel  is  lifted  adiabatically,  it  will  continue  to  accelerate  upward.  An  absolutely 
stable  atmosphere  will  have  a  lapse  rate  that  is  less  than  the  dry  adiabatic  lapse  rate  and 
the  saturated  adiabatic  lapse  rate.  Therefore  if  the  parcel  is  lifted  adiabatically,  it  will 
always  return  to  its  original  level. 

Convective  instability,  sometimes  referred  to  as  potential  instability,  is  a  term 
used  to  describe  a  column  of  air  that  has  a  wet  bulb  potential  temperature  and  equivalent 
potential  temperature  that  decreases  with  height.  Theoretically,  if  this  entire  column  of 
air  is  lifted  upward,  the  top  layer  will  cool  faster  than  the  lower  layer.  Therefore  the 
lapse  rate  of  the  column  will  increase  making  the  column  unstable.  Equivalent  potential 
temperature  is  an  important  concept  for  thunderstorms  in  terms  of  downburst  and  hail 
potential  because  it  is  sensitive  to  the  amount  of  moisture  in  the  atmosphere  (NWS  2003). 

c.  Stability  Indices 

Many  stability  indices  have  been  developed  by  the  weather  community  to 
describe  the  stability  of  the  troposphere  as  a  single  numerical  value  to  obtain  more 
accurate  thunderstorm  and  severe  weather  prediction.  The  strengths  and  weaknesses  of 
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each  index  are  crucial  for  the  forecaster  to  understand  when  applying  them  to  the 
prediction  of  upcoming  weather  events.  A  critical  point  to  keep  in  mind  is  if  the  indices 
are  not  utilized  with  other  information,  then  the  standard  stability  analyses  of  the 
complete  sounding  using  the  parcel  method  is  a  more  useful  method  to  use  (AWS  TR  79- 
006,  1990).  The  methods  used  to  determine  each  index  are  very  important  to  uncover  the 
relevance  of  the  index  toward  the  weather  pattern  or  conditions  in  the  area  of  interest. 

An  index  that  performs  superbly  on  the  Gulf  Coast  might  be  useless  in  the  Midwest  or 
Rocky  Mountain  regions. 

Peppier  (1998)  described  the  original  purpose  for  each  of  the  stability  indices. 

The  Showalter  Stability  Index  (SSI)  and  K  Index  (KI)  were  originally  developed  to 
predict  non-severe  thunderstorms  and  convective  showers.  The  Lifted  Index  (LI), 

Vertical  Totals  (VT),  Cross  Totals  (CT),  Total  Totals  Index  (TTI),  and  Severe  Weather 
Threat  Index  (SWEAT)  were  originally  created  to  forecast  severe  thunderstorms  and 
tornadoes.  Knowing  how  the  stability  index  was  developed  and  formulated  provides 
valuable  insight  toward  a  better  understanding  of  applying  the  index. 

The  subsequent  sections  contain  brief  descriptions  of  the  indices  used  in  this 
study,  commonly  used  values,  and  an  explanation  of  the  atmospheric  layers  involved  in 
the  calculations  of  each  index  used  in  this  research.  The  desired  end  state  for  this 
research  is  to  determine  if  an  index  or  a  combination  of  indices  would  best  predict  CG 
lightning  for  the  13  locations  under  the  watch  of  the  15th  OWS  at  Scott  AFB.  A  more 
detailed  description  of  each  index  can  be  found  in  the  articles  published  by  the  creators  of 
the  indices. 
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1)  TOTAL  TOTALS  INDEX  (TTI) 


Miller  (1972)  originally  developed  the  TTI  to  prediet  severe  weather  in  areas 
where  the  potential  for  thunderstorm  development  was  already  foreeasted  through  other 
means.  However;  sinee  TTI  is  a  eommonly  used  index,  it  will  be  used  to  prediet  CG 
lightning  for  this  researeh.  TTI  is  a  eombination  of  two  other  eommonly  used  indiees, 
the  Cross  Totals  (CT)  and  the  Vertieal  Totals  (VT).  The  standard  units  of  TTI,  CT,  and 
VT  are  Celsius  degrees.  The  TTI  is  eomputed  using  the  following  equations: 

TTI  =  T(850  mb)  +  Td(850  mb)  -  2[T(500  mb)],  (1) 

CT  =  Td(850  mb)  -  T(500  mb),  (2) 

VT  =  T(850  mb)  -  T(500  mb).  (3) 

Sinee  CT  is  the  differenee  between  the  dew  point  at  850  millibars  (mb)  and  the 
temperature  at  500  mb,  CT  eombines  eritieal  low-level  moisture  information  with  the 
temperatures  aloft.  For  regions  east  of  the  Roekies  and  along  the  Gulf  Coast,  CT  is  very 
effeetive  for  thunderstorm  eoverage  and  severity  (AFWA  1998).  However,  if  the 
moisture  and  eold  air  are  not  at  the  layers  used  in  the  CT  formula,  then  CT  will  not  be  an 
effective  indicator  of  thunderstorms.  VT  measures  the  lapse  rate  of  the  layer  between 
850  mb  and  500  mb.  In  the  west,  VT  has  been  shown  to  have  a  better  correlation  with 
thunderstorm  activity.  Although  CT  and  VT  can  be  used  alone,  when  combined,  they 
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make  the  TTI  a  more  reliable  predictor  of  severe  weather  potential  (AWS  1975). 
However,  a  forecaster  must  still  use  caution  since  a  large  TTI  can  occur  due  to  a  steep 
temperature  lapse  rate.  The  CT  or  low-level  moisture  should  be  evaluated  to  ensure  there 
is  enough  moisture  to  support  thunderstorm  development.  Table  2  demonstrates  that  the 
higher  the  value  for  TTI,  CT,  and  VT,  the  greater  the  potential  for  severe  thunderstorms. 

2)  K  INDEX  (KI) 

The  KI  was  developed  by  George  (1960)  to  estimate  the  potential  of  air  mass 
thunderstorms  using  the  vertical  temperature  lapse  rate  combined  with  available  moisture 
in  the  atmosphere.  The  KI  is  mainly  utilized  to  predict  heavy  rain  or  indicate 
thunderstorm  potential,  not  to  make  severe  versus  non-severe  decisions  (AFWA  1998). 
The  following  equation  is  used  to  calculate  a  value  for  KI: 

KI  =  T(850  mb)  -  T(500  mb)  +  Td(850  mb)  -  [T(700  mb)  -  Td(700  mb)].  (4) 

The  standard  units  of  the  KI  are  Celsius  degrees.  The  interpretation  of  the  KI  is 
the  more  positive  the  KI,  the  greater  the  potential  for  thunderstorm  development.  Table  3 
displays  a  commonly  used  scale  to  determine  thunderstorm  occurrence.  Notice  that  the 
KI  applies  to  maritime  tropical  air  masses  (mT)  and  the  Tropics. 

3)  SHOWALTER  STABIEITY  INDEX  (SHOW  or  SSI) 
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The  Showalter  Stability  Index  was  originally  developed  by  Showalter  (1953)  for 
the  southwestern  United  States  to  determine  thunderstorm  potential  based  on  the  850  mb 
to  500  mb  layer.  For  the  SSI,  a  pareel  is  lifted  from  850  mb  to  the  500  mb  level  and  the 
temperature  of  the  lifted  parcel  is  compared  with  the  environmental  temperature  at  500 
mb.  If  unsaturated,  the  parcel  is  lifted  dry  adiabatically  until  it  reaches  its  lifted 
condensation  level  and  from  there  it  is  lifted  moist  adiabatically  to  500  mb.  If  the  parcel 
is  already  saturated  at  the  850  mb  level  then  it  is  just  lifted  moist  adiabatically  to  the  500 
mb  level.  The  two  values  in  Celsius  degrees  are  compared  to  determine  the  stability  of 
the  layer.  SSI  values  can  be  calculated  using  the  following  equation: 

SSI  =  Tenvironment  (500  mb)  -  Tparcel  (500  mb).  (5) 
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Table  2.  Range  of  values  for  thunderstorm  prediction  using  TTI,  CT,  and  VT  (AFWA 
1998). 


Index 

Region 

Weak 

Moderate 

Strong 

Thunderstorms 

Thunderstorms 

Thunderstorms 

Total 

West  of 
Rockies 

48  to  51 

52  to  54 

>54 

Totals 

(TTI) 

East  of 
Rockies 

44  to  45 

46  to  48 

>48 

Europe 

>42 

>48 

>50 

Cross 

Totals  (CT) 

East  of 
Rockies 

Gulf  Coast 

<  I8N0TS 

<  16 

18  to  19 

20  to  21 

>20 

US:  General 

>26 

Gulf  Coast 

>23 

Vertical 

Totals 

West  of 
Rockies 

<  28  No  TS 

28  to  32 

>32 

(VT) 

UK 

>22 

Western 

Europe 

>28 

Table  3.  Range  of  values  for  thunderstorm  prediction  using  KI  (AFWA  1998). 

Index 

Region 

Weak 

Moderate 

Strong 

Thunderstorms 

Thunderstorms 

Thunderstorms 

K Index 

East  of  Rockies 
(mT  /  tropics) 

20  to  26 

26  to  35 

>35 

(KI) 

West  of  Rockies 
(mT) 

15  to  21 

21  to  30 

>30 

The  SSI  is  used  as  a  first  indicator  of  instability  and  performs  best  with  well- 
developed  storm  systems  in  the  Central  United  States  (AFWA  1998).  However,  it  is  not 
a  good  index  to  use  for  severe  weather  when  low  level  moisture  is  below  850  mb  or  when 
a  frontal  boundary  or  an  inversion  exists  between  the  850  mb  and  500  mb  layer. 
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The  NWS  commonly  used  the  SSI  as  a  measure  of  stability  of  the  environment, 
not  as  a  measure  of  severe  weather  potential.  Table  4  shows  the  values  of  SSI  used  by 
the  NWS.  Notice  as  the  values  for  SSI  decrease,  the  potential  for  thunderstorms 
increases.  SSI  is  one  of  the  most  common  indices  used  in  Air  Force  weather  for 
determining  the  instability  of  the  atmosphere  (AFWA  1998).  Table  5  shows  the  values 
commonly  used  by  Air  Force  weather  forecasters  to  interpret  the  potential  for 
thunderstorms. 

4)  LIFTED  INDEX  (LI) 

A  problem  was  noticed  with  the  Showalter  index,  so  Galway  (1956)  developed 
the  LI  to  solve  for  the  potential  weaknesses  of  the  SSI.  The  weakness  of  the  SSI  is  that  it 
arbitrarily  uses  850  mb  as  the  starting  point.  The  SSI  is  not  representative  of  atmospheric 
stability  in  a  region  when  there  is  an  inversion  present  or  a  rapid  drop  in  moisture 
between  stations  or  two  successive  soundings.  The  LI  uses  the  mean  3000-foot  layer 
temperature  and  the  LCL  for  the  starting  value  to  lift  the  parcel  up  to  the  500  mb  level. 
The  following  equation  can  be  used  to  calculate  a  value  for  the  LI; 

LI  =  TEnvironment(500  mb)  -  TParcel(500  mb).  (6) 


18 


Table  4.  Measure  of  stability  using  the  SSI  (NWS  2003). 


Showalter  Stability 
Index  (SSI) 

Stability 

+1  to  +2 

Stable  (Weak  convection  possible  if  strong  lift  present) 

0  to  -3 

Moderately  Unstable 

-4  to  -6 

Very  Unstable 

<-6 

Extremely  Unstable 

Table  5.  Range  of  values  for  thunderstorm  prediction  using  SSI  (AFWA  1998). 


Index 

Region 

Weak 

Moderate 

Strong 

Thunderstorms 

Thunderstorms 

Thunderstorms 

Showalter 

US 

^  +3 

+2  to  -2 

^  -3 

Stability 
Index  (SSI) 

Europe 

>  2  No  TS 

-  2  TS  possible 

The  temperature  of  the  parcel  lifted  adiabatically  to  500  mb  is  then  compared  with 
the  environmental  temperature  at  500  mb.  If  the  parcel  500  mb  temperature  is  warmer 
than  the  500  mb  environmental  temperature,  the  parcel  will  continue  to  accelerate 
upward,  thus  it  is  considered  unstable.  However,  if  the  parcel  500  mb  temperature  is 
cooler  than  the  500  mb  environmental  temperature,  then  it  will  sink  and  be  considered 
stable. 

Table  6  shows  the  common  values  used  by  the  National  Weather  Service  for 
measuring  the  potential  for  convective  activity.  The  LI  values  in  Table  6  are  based  on 
the  boundary  layer  temperature  and  moisture  values.  The  degree  of  stability  is 
determined  from  the  values  and  then  inferred  to  predict  the  potential  for  thunderstorms. 
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The  Air  Force  version  of  the  LI  table  applies  the  LI  values  directly  to  thunderstorm 
potential  in  Table  7. 

5)  SEVERE  WEATHER  THREAT  INDEX  (SWEAT) 

The  AWS  and  civilian  community  recognized  the  requirement  for  a  stability 
index  to  both  specify  and  predict  areas  of  potentially  severe  convective  weather  (AWS, 
1975).  The  SWEAT  index  was  developed  to  integrate  the  thermodynamic  and  kinematic 
properties  of  the  atmosphere  into  one  index  to  indicate  the  potential  for  severe 
thunderstorms  and  tornadoes.  Strict  constraints  were  set  on  the  new  index  to  ensure  the 
availability  of  a  more  timely  and  accurate  forecast  tool.  The  index  must  be: 

1 .  Computed  from  upper  air  data, 

2.  Available  one  hour  and  15  minutes  after  balloon  launch, 

3.  Computed  from  current  fields  in  data  base, 

4.  Not  dependent  on  derived  parameters  or  complex  pattern  recognition. 

Three  versions  of  the  SWEAT  index  were  developed  by  Bidner  (1970),  Miller  et 

al.  (1971),  and  Miller  (1972).  The  original  version  developed  by  Bidner  did  not  include 
the  shear  term  that  was  added  to  the  second  version,  which  is  most  widely  known  and 
used.  The  third  version  of  SWEAT  relocated  the  height  at  which  the  dew  point 
temperatures  were  measured,  from  850  mb  to  900  meters.  The  shear  measurement  was 
changed  from  the  850  mb  level  to  a  step  function  to  take  into  account  shear  of  the  layer 
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Table  6.  Common  values  of  Lifted  Index  (LI)  used  for  predicting  atmospheric  stability 
(NWS  2003). 


Lifted  Index  (LI) 

Stability 

LI  over  0 

Stable  but  weak  convection  possible  for  LI=  1  -3  with  strong  lift 

LI  =  0  to  -3 

Marginally  unstable 

LI  -3  to  -6 

Moderately  unstable 

LI  -6  to  -9 

Very  unstable 

LI  below  -9 

Extremely  unstable 

Table  7.  Range  of  values  for  thunderstorm  prediction  using  LI  (AFWA  1998). 


Index 

Region 

Weak 

Moderate 

Strong 

Thunderstorms 

Thunderstorms 

Thunderstorms 

Lifted  Index 
(LI) 

All 

0  to  -2 

-3  to  -5 

-5  and  lower 

from  900  meters  to  500  mb.  For  this  research,  the  focus  will  be  on  the  second,  most 
widely  used  version  of  SWEAT,  which  is  given  by  the  following  formula: 

SWEAT  =  12(^)  +  (20)(m  -  49)+  2(/8)  +  /5  +  (125)(5  +  0.2) 

where  A  is  the  dew  point  at  850  mb,  TTI  is  the  result  found  from  the  Total  Totals  Index, 
f8  is  the  850  mb  wind  speed  (in  knots),  f5  is  the  500  mb  wind  speed  (in  knots),  and  the 
shear  term  S  is  the  sine  of  the  angle  of  the  500  mb  wind  direction  minus  the  850  mb  wind 
direction.  If  a  term  in  the  equation  is  negative,  the  term  is  set  to  zero.  It  is  also  important 
to  know  that  the  shear  term  is  set  to  zero  if  the  following  criteria  are  not  met: 

1.  850  mb  winds  are  between  130  to  250  degrees. 
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2.  500  mb  winds  are  between  210  to  3 10  degrees. 

3.  500  mb  wind  direction  minus  the  850  mb  wind  direction  is  not  positive. 

4.  The  850  mb  and  500  mb  wind  speeds  are  at  least  15  knots. 

The  SWEAT  index  was  created  to  distinguish  between  severe  and  non-severe 
storms,  so  it  should  not  be  used  to  forecast  for  general  thunderstorms  (AWS,  1975). 
However,  the  SWEAT  index  was  used  in  this  research  since  the  focus  is  on  the  prediction 
of  CG  lightning  from  all  thunderstorms. 

The  Air  Weather  Service  performed  a  case  study  to  test  the  performance  of  the 
SWEAT  index  on  past  occurrences  of  severe  weather.  The  past  cases  were  grouped  into 
two  categories:  tornadoes  or  other  severe  weather  criteria.  For  the  study,  159  severe 
storms  were  used  and  the  values  in  Table  8  are  the  results  of  the  study.  See  AWS  (1975), 
for  more  detailed  information  on  the  study  performed.  False  alarm  rates  were  not  taken 
into  account  since  the  study  only  included  storms  that  contained  severe  criteria. 

6)  KO  INDEX  (KO) 

The  German  Weather  Bureau  developed  the  KO  index  in  an  effort  to  better 
predict  thunderstorms  in  the  European  region.  The  KO  index  is  responsive  to  the  amount 
of  moisture  present  and  performs  best  in  the  cooler  climates  of  Europe  and  the  Pacific 
Northwest.  The  complexity  and  method  for  calculating  the  KO  index  are  the  major 
drawbacks  to  its  use.  The  following  equation  is  used  to  calculate  the  KO  index. 

9^  (500mh)  +  0^  (700mh)  9^  (850mh)  +  9^  (1  OOOmh) 

KO  =  2  2  .  (8) 
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where  0e  is  the  equivalent  potential  temperature  for  each  level.  0e  can  be  found  by 
locating  the  LCL  for  the  level  of  interest  and  continuing  up  moist  adiabatically  until  all 
moisture  is  removed,  where  the  moist  and  dry  adiabats  are  parallel.  Then  continue  from 
there  dry  adiabatically  to  the  top  of  the  chart  and  read  the  value  (AFWA,  1998).  Table  9 
was  developed  for  USAF  weather  forecasters  to  apply  the  values  of  the  KO  index 
towards  thunderstorm  forecasting. 

7)  CONVECTIVE  AVAILABEE  POTENTIAL  ENERGY  (CAPE). 

CAPE  involves  the  vertical  integration  of  the  atmospheric  profile  to  determine  a 
measure  of  the  maximum  possible  energy  available  for  buoyancy  and  updrafts.  CAPE  is 
measured  from  the  level  of  free  convection  (EEC)  to  the  equilibrium  level  (EL)  on  the 
Skew-T  log  P  diagram.  The  parcel  can  be  lifted  from  the  boundary  layer  or  the  surface, 
therefore,  the  value  of  CAPE  depends  on  the  height  from  which  the  parcel  was  lifted. 
The  higher  the  value  of  CAPE  measured,  the  greater  the  potential  for  thunderstorms. 


Table  8.  The  accepted  values  of  the  SWEAT  index  for  severe  weather  (NWS,  2003). 


Severe  Weather  Threat  (SWEAT) 
Index 


Thunderstorm  Potential 


SWEAT  over  300 
SWEAT  over  400 


Potential  for  severe  thunderstorms 
Potential  for  tornadoes 
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Table  9.  Range  of  values  for  thunderstorm  prediction  using  KO  (AFWA,  1998). 


Index 

Region 

Weak 

Moderate 

Strong 

Thunderstorms 

Thunderstorms 

Thunderstorms 

Cool,  moist 

KO-Index 

climates: 

>6 

2  to  6 

<2 

(KO) 

Europe,  Pacific 

NW 

The  shape  of  the  positive  area  is  a  critical  detail  about  CAPE  that  must  be 
considered  when  trying  to  determine  the  type  of  thunderstorm  that  could  potentially 
develop.  A  long,  thin  positive  area  represents  a  slow  vertical  acceleration  but  higher  tops 
where  a  short,  fat  positive  area  involves  rapid  acceleration.  A  tall,  thin  profile  suggests 
the  potential  for  high  precipitation  thunderstorms  and  a  short,  fat  profile  indicates  a 
potential  for  rotating  updraft  development  (NWS,  2003).  Table  10  shows  the  values 
considered  by  Air  Force  Weather  forecasters  when  determining  the  potential  for 
thunderstorms  (AFWA,  1998).  As  with  other  parameters,  the  NWS  uses  slightly 
different  values  than  AFWA  and  uses  the  values  as  a  stability  indicator  for  its  forecasting 
purposes.  Table  1 1  indicates  the  values  a  NWS  forecaster  would  consider  when  using 
CAPE  as  an  indication  for  thunderstorm  potential.  The  following  equation  is  one  of  the 
variations  used  to  determine  the  values  of  CAPE; 


EL 

CAPE  =  g  j 

LFC 


(T, 


Parcel 


-T 

Environment 


T 

Environment 


(9) 
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where  g  is  gravity  and  T  represents  the  temperature  for  eaeh  level.  The  units  for  CAPE 
are  Joules  per  kilogram.  Another  variation  of  CAPE  uses  virtual  temperature  instead  of 
temperature. 

CAPE  is  technically  not  a  stability  index  like  the  SI  and  El  since  the  units  of 
CAPE  are  energy  and  not  temperature  and  the  standard  indices  compare  temperature 
differences  between  layers  (Blanchard,  1998).  In  his  study,  Blanchard  (1998)  found  only 
moderate  correlations  between  other  common  stability  indices  and  CAPE.  He  concluded 
the  low  correlations  were  a  function  of  the  difference  between  what  the  indices  were 
actually  measuring  in  the  atmosphere.  However;  the  NWS  (2003)  often  considers  CAPE 
to  be  better  than  standard  indices  for  indicating  instability  since  CAPE  is  calculated  by 
integrating  the  whole  layer  and  is  not  dependent  upon  a  certain  level.  CAPE  is  included 
in  this  research  as  a  possible  predictor  of  CG  lightning  since  it  is  used  throughout  the 
weather  community  as  a  tool  to  determine  instability  and  the  possibility  of 
thunderstorms. 
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Table  10.  Range  of  values  for  thunderstorm  prediction  using  CAPE  (AFWA,  1998). 


Index 

Region 

Weak 

Moderate 

Strong 

Thunderstorms 

Thunderstorms 

Thunderstorms 

CAPE  (J/kg) 

East  of 
Rockies 

300  to  1000 

1000  to  2500 

2500  to  5300 

Table  11.  The  accepted  values  of  CAPE  (J/kg)  for  determining  stability  (NWS,  2003). 


Convective  Available  Potential  Energy 
(CAPE) 

Stability 

CAPE  below  0 

Stable 

CAPE  =  0  to  1000 

Marginally  unstable 

CAPE  =  1000  to  2500 

Moderately  unstable 

CAPE  =  2500  to  3500 

Very  unstable 

CAPE  above  3500-4000 

Extremely  unstable 
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3.  Data  and  Methodology 


a.  Overview 

One  of  the  goals  for  this  researeh  was  to  find  a  user  friendly  predietion  tool  for 
CG  lightning  for  eaeh  of  the  loeations  in  15*  OWS  AOR.  Keeping  this  main  objeetive  in 
mind,  the  predietors  were  limited  to  a  group  that  eould  easily  be  ereated  and  used  by  the 
foreeaster  in  the  field.  All  the  data  used  in  this  research  were  provided  by  Air  Force 
Combat  Climatology  Center  (AFCCC).  The  data  set  consisted  of  CG  lightning  data  from 
the  NLDN,  surface  data  provided  from  each  location,  and  upper  air  data  obtained  from 
the  rawinsonde  sounding  data.  A  major  concern  not  previously  considered  by  Venzke 
(2001)  was  the  location  of  fronts,  troughs,  or  any  other  synoptic  weather  feature  in 
relation  to  the  upper  air  station.  By  separating  the  point  of  interest  from  the  upper  air 
station,  the  variation  in  weather  across  a  distance  as  much  as  200  miles  could  decrease 
the  value  of  the  results  achieved  in  this  research. 

Sahu  and  Singh  (1999)  tried  using  over  128  various  single  station  predictors,  with 
a  maximum  model  of  12,  to  forecast  the  categorical  occurrence  of  thunderstorms  in  India. 
They  used  two  types  of  data  for  the  research,  hourly  surface  observations  and  Radiosonde 
data  for  OOZ  and  12Z,  and  considered  the  forecast  area  as  a  100  km  radius.  The 
regression  equations  were  validated  with  independent  data,  and  the  results  provided  a 
probability  of  detection  of  72.5%  for  OOZ  and  70.9%  for  12Z,  and  a  false  alarm  rate  of 
39.3%  and  37.1%  respectfully.  Relying  on  surface  observation  for  thunderstorm 
verification  was  one  limitation  to  the  research.  Some  thunderstorm  activity  was  missed 
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due  to  the  spaeing  of  the  loeations  eombined  with  the  mesoseale  nature  of  thunderstorms. 
The  results  aehieved  were  promising  eonsidering  the  limitations.  This  researeh  took  a 
similar  approaeh  by  using  both  surfaee  and  upper  air  data  but  used  the  NLDN  to  obtain  a 
more  aeeurate  eount  of  CG  lightning  to  use  as  the  predietand.  The  knowledge  obtained 
from  both  Venzke  (2001)  and  Sahu  and  Singh  (1999)  helped  in  the  seleetion  proeess  for 
the  predietors  used  in  the  deeision  tree  building  proeess.  The  following  rules  were 
required  to  ensure  the  forecast  tool  would  be  valuable  to  forecasters  in  the  field:  1)  the 
predictor  was  created  from  data  that  would  be  readily  available  to  forecasters  in  the  field 
and  2)  the  calculations  were  required  to  remain  relatively  simple  to  ensure  the  timeliness 
of  the  forecast  tool. 

Reap  (1994)  also  did  research  on  predicting  thunderstorms  using  prediction  tools. 
He  developed  experimental  thunderstorm  probability  equations  based  on  large-scale 
synoptic  forcing.  He  used  the  K  stability  index  combined  with  lightning  frequencies  as 
predictors  for  the  research  in  which  he  used  pattern  classification  to  develop  map  patterns 
to  create  climatology  of  lightning  distributions  for  each  synoptic  situation.  In  the  study 
he  focused  on  the  “warm  season”  period  of  March  thru  September.  The  following 
predictors  were  used  in  the  study  by  Reap  (1994)  and  in  this  research:  wind,  surface 
pressure,  Total  Totals  Index  (TTI),  K  index  (KI),  wind  shear,  and  temperature  advection. 


b.  Data 
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Choosing  the  best  data  set  for  this  research  involved  determining  the  best  time  of 
year  so  the  variability  of  the  upper  air  stability  indices  is  great  enough  and  there  were 
enough  CG  lightning  strikes  to  draw  reasonable  conclusions.  The  15**^  OWS  AOR 
followed  a  seasonal  pattern  with  June  and  July  as  the  peak  months.  Thunderstorm 
damages  in  the  northern  regions  of  the  U.S.  also  had  a  narrow  distribution  centered  on 
the  summer  months  (NWS  1997).  Reap  (1994)  showed  that  even  for  Florida  a  lightning 
study  can  focus  on  the  warm  season  due  to  the  normal  distribution  of  the  CG  flash  count 
per  day  centered  over  June  and  July.  Venzke  (2001)  also  concluded  that  the  frequency  of 
lightning  is  significantly  lower  during  the  cool  months  October  thru  April,  therefore  a 
warm  season  (1  March  thru  30  September)  data  set  was  chosen.  Table  12  shows  the 
locations  matched  with  the  upper  air  stations  used  for  this  research. 

1)  SURFACE  DATA 

Venzke  (2001)  focused  on  stability  indices  in  his  research,  but  as  mentioned 
before,  his  research  was  based  on  one  location,  not  separate  locations  as  in  this  research. 
Therefore,  surface  data  were  included  to  add  more  predictors  to  help  offset  the 
shortcomings  of  using  just  upper  air  data.  The  surface  winds  and  station  pressures  at  the 
points  of  interest  were  used  in  comparison  with  the  same  data  at  the  upper  air  station  to 
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Table  12.  15**^  OWS  locations  matched  with  the  upper  air  stations  used  in  this  research. 


Location 

UPPER  AIR  ST  NAME 

EAT 

LON 

ELEV 

Dover 

724030  VA 

WASHINGTON/DULLES 

38.983 

-77.467 

95  m 

Andrews 

724030  VA 

WASHINGTON/DULLES 

38.983 

-77.467 

95  m 

Ft  Belvoir 

724030  VA 

WASHINGTON/DULLES 

38.983 

-77.467 

95  m 

McGuire 

725200  PITSBURGH 

40.52 

-80.22 

359m 

WPAFB 

724260  OH  WILMINGTON  RAOB 

39.417 

-83.817 

323  m 

WPAFB 

724290  OH  DAYTON/JAMES  M 
COX 

39.867 

-84.117 

298  m 

Westover 

725180  NY  ALBANY  COUNTY 
ARPT 

42.75 

-73.8 

86  m 

Ft  Drum 

725280  NY  BUFFALO  INTL  ARPT 

42.933 

-78.733 

218  m 

Scott 

725320  IE  PEORIA  REGIONAL 

40.667 

-89.683 

201  m 

Scott 

745600  IE  LINCOLN  UPPER- AIR 

40.15 

-89.333 

178  m 

Offutt 

725530  NE  NORTH  OMAHA 

41.367 

-96.017 

399  m 

Offutt 

725580  NE  OMAHA/VALLEY 

41.317 

-96.367 

350  m 

Ellsworth 

726620  SD  RAPID  CTY  RGNL 
ARPT 

44.067 

-I03.2I7 

1029  m 

Grand  Forks 

727640  ND  BISMARCK 
MUNICIPAL 

46.767 

-100.75 

505  m 

Minot 

727680  MT  GLASGOW  INTL 
ARPT 

48.217 

-I06.6I7 

696  m 

Grissom 

744550  lA  DAVENPORT  UPPER- 
AIR 

41.617 

-90.583 

229  m 

determine  similarities  in  air  mass.  The  difference  in  station  pressure  from  the  upper  air 
site  and  the  surface  station  and  the  three  hour  surface  station  pressure  change  was  also 
added  to  the  problem  to  determine  if  they  could  be  used  as  a  CG  lightning  prediction 
tool.  Using  the  extra  surface  terms  provided  the  research  with  several  more  predictors, 
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which  could  possibly  increase  the  value  of  the  findings.  Determining  frontal  location 
manually  was  considered.  However,  frontal  location  is  very  subjective  and  locating  daily 
surface  charts  for  1 1  years  proved  an  overly  difficult  task. 

2)  UPPER  AIR  DATA  /  STABILITY  INDICES 

The  stability  indices  used  in  this  researeh  were  computed  by  AECCC  using 
archived  upper  air  data  and  EORTRAN  algorithms  written  speeifically  to  determine  the 
value  for  eaeh  index.  Various  quality  control  measures  were  implemented  to  limit  the 
number  of  errors  in  the  data  set.  The  data  set  was  manually  checked  for  errors.  A  value 
threshold  formula  was  applied  to  each  index  to  verify  that  the  indices  were  in  the 
acceptable  range.  Eor  example,  negative  values  were  not  accepted  for  TTI  and  CAPE. 

The  upper  air  data  were  obtained  from  rawinsonde  balloon  flights  from  the 
stations  listed  in  table  13.  The  rawinsonde  measures  the  atmospheric  column  and  records 
the  following  data:  temperature,  pressure,  dew  point,  wind  speed,  and  wind  direction. 

The  measurements  are  assumed  to  be  directly  overhead  from  the  launch  location, 
however  the  balloon  aetually  drifts  with  the  atmospherie  winds  as  it  ascends.  There  are 
two  main  sources  for  error  in  the  rawinsonde  data:  1)  the  balloon  does  not  rise  at  the 
standard  rate  of  300  meters  per  minute,  and  2)  a  lag  time  in  the  sensors  (Allen  2003). 

The  pressure  and  temperature  lag  time  are  of  major  concern,  since  both  pressure  and 
temperature  are  the  primary  items  used  to  determine  stability  indices.  Golden  et  al. 
(1986)  determined  that  the  lag  time  for  temperature  sensors  was  4  to  20  seconds  and 
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increased  with  height.  Golden  et  al.  (1986)  also  eoncluded  that  the  standard  error  for 
pressure  was  ±  1  mb  at  the  surface  and  ±  2  mb  at  500  mb. 

3)  LIGHTNING  DATA 

The  lightning  data  used  in  this  researeh  were  cloud-to-ground  lightning  strikes  as 
reported  by  the  NLDN  to  be  within  25nm  and  lOnm  of  the  13  loeations  previously 
defined  under  the  watch  of  the  15**'  OWS.  The  main  focus  of  this  research  was  the 
foreeasting  of  CG  lightning.  There  were  no  attempts  to  determine  the  severity  of  the 
individual  storms  since  it  is  beyond  the  seope  of  this  researeh.  Also,  due  to  limitations  in 
the  sensors  used  in  the  detection  of  lightning,  no  intra-cloud  lightning  can  be  inferred  in 
this  study  (Cummins  et  ah,  1998).  Orville  and  Huffmes  (1998,  2000)  graphieally 
displayed  normal  curves  for  flash  eounts  whieh  eentered  over  June  and  July.  They  also 
showed  that  the  months  of  January,  February,  October,  November,  and  December 
eontained  very  low  flash  counts.  So,  to  ensure  availability  of  enough  CG  lightning  data, 
this  researeh  will  foeus  on  the  months  March  thru  September.  Waeker  and  Orville, 
(1999a)  concluded  the  data  before  and  after  the  1994  upgrade  did  not  contain  significant 
ambiguities  and  are  aeeeptable  for  researeh. 

Venzke  (2001)  concluded  that  there  were  too  few  lightning  strikes  within  10  and 
25  nm  to  develop  a  relationship,  so  he  used  lightning  data  within  50  nm  to  represent  the 
13  upper  air  stations  ehosen  in  his  researeh.  The  15*  OWS  was  more  concerned  with 
lightning  within  a  smaller  radius  so  this  researeh  focused  on  25  nm  and  10  nm. 
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The  CG  lightning  data  were  grouped  into  two  categories  to  match  the  upper  air 
data.  The  OOZ  lightning  count  consisted  of  CG  lightning  that  occurred  within  a  25  nm 
and  a  10  nm  radius  of  the  location  from  OOOOZ  to  1 159Z  and  the  12Z  lightning  count 
contained  CG  lightning  within  a  25  nm  and  a  10  nm  radius  of  the  location  from  1200Z  to 
2359Z. 


c.  Statistical  Methodology 

Statistics  evaluates  and  quantifies  uncertainty  and  makes  inferences  and  forecasts 
about  the  uncertainty  (Wilks  1995).  Simple  linear  regression  is  the  comparison  of  two 
variables  to  fit  a  linear  equation  to  the  observed  data.  The  data  should  be  compared  using 
a  scatterplot  to  see  if  there  is  a  relationship  between  the  variables  of  interest.  If  there  is 
no  noticeable  correlation,  then  a  linear  regression  model  would  not  provide  a  valuable 
tool. 

Since  weather  uses  a  number  of  stability  indices  for  thunderstorm  prediction,  a 
different  method  was  needed  to  account  for  any  correlation  between  multiple  variables. 
The  method  of  multiple  linear  regression  was  applied  to  the  data  sets  to  determine  if  a 
usable  tool  could  be  found.  Multiple  linear  regression  is  a  method  of  regression  analysis 
that  involves  more  than  one  regressor  variable  (Montgomery  and  Runger  2003). 

Linear  regression  was  not  chosen  for  this  research  because:  1)  predictors  and  predictands 
forecasting  weather  outcomes  typically  do  not  display  a  linear  correlation,  2)  linear 
regression  equations  are  difficult  to  use  in  weather  forecasting  due  to  the  number  of 
variables,  and  3)  multiple  outcomes  are  possible  for  the  same  value  of  the  predictor.  The 
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number  of  variables  ehosen  to  predict  CG  lightning  in  this  research  created  a  very 
complicated  multivariable  regression  equation.  The  goal  of  the  research  was  to  find  a 
technique  to  predict  CG  lightning  to  be  used  in  the  forecast  community,  therefore  the 
results  needed  to  be  user  friendly  and  timely.  So  for  this  research,  a  newer  statistical  tool 
was  used  to  produce  a  valuable  prediction  model.  However,  the  results  from  the  new 
model  will  be  validated  using  classical  statistics  (see  chapter  4  for  results). 


d.  CART 

1)  CART  OVERVIEW 

Classification  and  regression  tree  (CART)  analysis,  developed  by  Salford 
Systems,  utilizes  the  tree  building  technique  to  define  the  complex  relationships  between 
several  predictors  and  the  target  values  (predictands).  A  major  break  through  in 
statistical  evaluations,  CART  is  a  computer  intensive  technique  that  can  automatically 
analyze  any  number  of  variables,  regardless  of  missing  data  regions  or  outliers,  and 
create  a  simple  yet  effective  model.  CART  analysis  takes  advantage  of  a  binary  recursive 
partitioning  system  which  divides  a  major  category  known  as  “nodes”  into  two  child 
nodes. 

CART  uses  a  decision  tree  to  represent  the  entire  model  or  analysis  as  determined 
from  the  interaction  between  the  relevant  predictors  and  the  predictands.  The  main  nodes 
divide  to  child  nodes  using  rules  established  by  the  model  to  determine  the  proper  split  at 
each  level.  The  questions  used  to  determine  the  split  are  formulated  so  that  only  two 
answers  are  possible.  Eor  example  is  SSI  less  than  0?  If  yes,  the  case  will  split  to  the  left 
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or  if  no,  the  case  will  take  the  right  hand  path.  The  path  ends  at  a  terminal  node  at  which 
time  the  object  is  classified  and  all  the  rules  used  to  reach  the  terminal  node  can  be 
reviewed.  This  method  supplies  the  end  user  the  rules  to  follow  from  the  initial  to  final 
decision  for  solving  their  problem.  CART  provides  a  simpler  interpretation  than  a 
multivariate  regression  model  making  it  an  ideal  tool  to  use  in  the  weather  forecast 
decision  process. 

(i)  Advantages  of  Using  CART  as  a  Statistical  Tool 

CART  is  non-parametric  because  no  assumptions  are  made  about  the  distributions 
of  the  data  sets.  Therefore  it  can  work  with  numerical  data  that  are  highly  skewed  or 
multi-modal  and  also  work  with  categorical  predictors  as  well.  Researchers  save  time 
that  otherwise  would  be  used  to  determine  the  normality  of  the  data  and  to  transform  data 
sets  that  are  not  normal.  CART  searches  all  possible  variables  to  determine  the  splits 
required  to  make  the  decisions  even  if  the  problem  contains  hundreds  of  variables. 

CART  can  create  decision  trees  even  if  some  of  the  predictor  variables  are  missing  from 
certain  areas  of  the  data.  “Surrogate”  variables  which  contain  similar  information  to  the 
actual  variables  are  used  in  place  of  the  missing  variables.  Thus  decision  trees  made  for 
data  sets  with  missing  data  use  both  the  actual  and  the  surrogate  variables  to  determine 
the  splitting.  CART  analysis  is  a  relatively  automatic  method  which  requires  very  little 
input  from  the  user,  unlike  multivariate  models  which  require  extensive  input,  analysis  of 
early  results  and  modification  of  the  methods  used  to  create  a  useable  model.  CART 
results  are  displayed  as  trees  which  the  end  users  understand  easier  since  the  structure  of 
the  rules  and  their  logic  is  apparent. 
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(ii)  Disadvantages  of  Using  CART  as  a  Statistical  Tool 

CART  analysis  is  new  and  not  well-known,  therefore  some  traditional 
statisticians  are  reluctant  to  accept  the  process.  Due  to  earlier  poor  performances  and 
unrealistic  claims  by  other  tree  methods,  CART  must  overcome  a  common  distrust. 

CART  help  is  difficult  to  find  since  it  is  not  a  standard  technique  and  it  is  not  included  in 
many  major  statistical  software  packages. 

2)  CART  CLASSIFICATION  TREES 

Eewis  (2000)  discussed  the  four  components  to  a  classification  problem:  1)  a 
categorical  outcome  or  dependent  variable  which  one  wishes  to  determine,  2)  the 
predictor  variables  or  independent  variables  and  the  possible  relationship  with  the 
outcome,  3)  the  data  set  which  contains  the  values  for  the  outcome  and  each  of  the 
predictor  values,  and  4)  the  test  data  set  for  validating  the  decision  rules  created.  CART 
takes  a  categorical  data  set  and  develops  a  decision  tree  based  on  all  possible 
combinations  of  the  data.  The  CART  program  allows  for  user  input  during  certain  phases 
in  the  tree  building  process.  The  following  were  used  in  this  research  to  help  develop  the 
most  reliable  decision  tree  based  on  the  information  provide  by  the  user  manual. 

(i)  Cost  Matrix 

A  cost  matrix  is  one  way  CART  allows  the  user  to  adjust  the  importance  of  the 
categorical  predictands.  To  determine  the  cost  matrix  for  the  CG  lightning  problem,  one 
must  decide  if  it  is  equally  as  bad  to  misclassify  thunderstorm  occurrence  versus  non- 
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occurrence.  To  weigh  the  eosts  equally  will  reduee  the  false  alarm  rate,  however  it  will 
also  reduee  the  predietability  rate  for  CG  lightning.  For  this  researeh  two  eost  matrix 
methods  will  be  applied  to  eaeh  loeation;  one  method  that  optimized  the  predietion  of  CG 
lightning  but  at  the  expense  of  higher  false  alarm  rates  and  the  other  method  that  used 
equal  eosts  to  give  the  maximum  predietability  rate  while  also  foeusing  on  redueing  false 
alarm  rates. 

(ii)  Variable  Importanee 

An  advantageous  benefit  of  using  the  CART  analysis  program  to  data  mine  is  the 
ability  of  CART  to  determine  strietly  from  the  data  a  numerieal  grouping  of  the 
predietors  for  eaeh  deeision  tree  based  on  their  importanee  to  the  outeome.  For  eaeh 
deeision  tree  ereated,  the  user  ean  easily  determine  whieh  variables  are  important  and 
whieh  ones  are  not.  From  this  information,  the  user  ean  eliminated  the  useless  predietors 
and  rebuild  the  deeision  tree  with  only  the  predictors  determined  by  CART  to  be  of 
predietion  value. 

(iii)  Priors 

The  priors  tab  of  the  CART  program  allows  the  user  to  ehoose  the  influence  of 
the  data  set  on  the  overall  model.  There  are  six  user  choiees  1)  priors  equal,  2)  priors 
learn,  3)  priors  test,  4)  priors  data,  5)  priors  mix,  and  6)  priors  speeify.  The  ehoiee  of 
priors  is  based  on  the  data  set  and  user  requirements.  Priors  equal  make  the  probability 
of  eaeh  elass  oeeurring  equal.  With  priors  learn  CART  matehes  the  probabilities  with  the 
learn  sample  frequeneies.  Similarly,  for  priors  test,  CART  matches  the  probabilities  with 
the  test  sample  frequeneies.  Priors  data  uses  the  probabilities  of  the  total  sample 
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frequencies.  Priors  mixed  combines  the  average  of  the  priors  equal  and  priors  data. 
Finally,  priors  specify  allows  the  user  to  set  the  probabilities  of  each  class. 

This  research  used  priors  equal  since  this  selection  gives  each  class  an  equal 
chance  to  be  classified  correctly.  The  other  methods  were  discounted  for  various 
reasons.  The  CART  user  manual  described  priors  data  as  least  likely  to  give  positive 
results  when  focusing  on  a  class  with  lower  frequency  (Salford  Systems  1995).  Priors 
data  will  cause  CART  to  focus  on  correctly  classifying  the  larger  class.  For  this  research, 
CG  lightning  frequency  average  approximately  10%,  therefore  priors  data  or  any 
combination  of  it  was  eliminated  as  an  option  since  it  would  focus  on  the  nonoccurrence 
of  CG  lightning.  This  decision  eliminated  all  choices  excepted  priors  equal  and  priors 
specify.  To  eliminate  human  error,  priors  specify  was  also  not  chosen  since  it  required 
the  user  to  make  a  decision  that  would  affect  the  entire  tree  building  process. 

3)  SPLITTING  RULES  OF  CART 

CART  allows  the  user  to  choose  from  six  different  splitting  methods;  Gini, 
Symmetric  Gini,  Entropy,  Class  Probability,  Twoing,  and  Ordered  Towing.  The  user 
must  decide  which  rule  is  best  for  the  data  based  on  knowledge  of  each  tool.  The 
following  explanation  on  splitting  rules  can  be  found  in  the  CART  manual  (Salford 
Systems  2002). 

(i)  Gini 

The  Gini  method  is  the  standard  splitting  rule  that  splits  the  data  to  obtain  a  one 
class  prevailing  terminal  node.  The  Gini  method  is  considered  the  best  for  a  two-level 
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dependent  variable  that  ean  be  predieted  with  a  relative  error  less  than  0.5.  Costs  are 


ineorporated  in  the  Gini  method  by  adjusting  the  prior  probabilities  before  the  tree  is 
grown. 

(ii)  Symmetric  Gini 

The  Symmetric  Gini  method  differs  from  the  Gini  method  only  in  the  way  the 
method  handles  cost.  The  costs  in  the  Symmetric  Gini  method  are  made  symmetric  and 
incorporated  into  the  impurity  function  at  the  tree  growing  stage. 

(iii)  Entropy 

The  Entropy  method  looks  for  splits  where  as  many  levels  as  possible  are  divided 
as  perfectly  as  possible.  As  a  result,  Entropy  emphasizes  getting  rare  events  correct 
relative  to  the  common  events. 

(iv)  Class  Probability 

The  Class  Probability  forces  CART  to  build  probability  trees  instead  of 
classification  trees.  A  class  probability  tree  attempts  to  separate  segments  of  the  data  by 
different  probabilities  of  response. 


(v)  Twoing 

The  Twoing  method  differs  from  the  Gini  method  on  the  multilevel  targets. 
Twoing  generates  more  even  splits  separating  whole  groups  of  classes.  Twoing  tends  to 
be  best  for  target  variables  with  four  to  nine  levels  and  for  two-level  dependent  variables 
predicted  with  a  relative  error  of  0.8  or  better. 

(vi)  Ordered  Twoing 
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Ordered  Towing  is  a  variation  of  the  Twoing  method  designed  for  ordered  targets. 
The  rule  will  group  target  elasses  that  are  adjaeent  to  eaeh  other.  For  example, 

(1,2, 3, 4, 5, 6)  would  be  grouped  (1,2,3)  and  (4,5,6).  Ordered  Twoing  works  best  with 
numeric  levels  and  does  not  work  well  when  the  target  is  a  character. 

The  six  splitting  rules  were  applied  to  the  CG  lightning  data  sets  to  determine 
which  method  would  provide  the  most  beneficial  outcome.  The  CART  user’s  manual 
provided  several  rules  of  thumb  which  were  considered  as  the  testing  phase  was 
performed.  Based  on  the  size  and  type  of  data  sets  used  and  the  results  desired  for  this 
research,  the  rules  of  thumb  supplied  in  the  CART  user’s  manual  provided  guidance  to 
eliminate  three  of  the  splitting  rules:  Symmetric  Gini,  Class  Probability,  and  Ordered 
Twoing.  For  most  of  the  data  sets,  there  was  very  little  difference  between  the  Gini, 
Twoing,  and  Entropy  methods.  However,  overall  the  Gini  method  produced  the  best 
results  when  a  difference  could  be  determined  and  will  be  used  as  the  primary  method  for 
CART  analysis. 


4)  DATA  VALIDATION 

The  categorical  trees  were  validated  using  the  cross  validation  technique  and  an 
independent  data  set  containing  2003  data.  Freestrom  (2001)  stated  the  cross  validation 
method  had  several  advantages  over  other  methods.  1)  The  cross  validation  method  does 
not  hold  out  data.  When  the  data  set  only  contains  a  few  hundred  occurrences  of  CG 
lightning,  holding  out  random  data  would  greatly  reduce  the  effectiveness  of  the  model. 
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2)  The  user  ean  ehoose  the  number  of  eross  validation  trees  desired  to  perform  the  tests. 
The  eross  validation  method  builds  the  ehosen  number  of  trees  and  eompares  the  optimal 
tree  with  the  other  trees  built. 

CART  also  gives  the  user  the  opportunity  to  test  the  trees  using  an  independent 
data  set.  The  test  data  ean  be  used  during  the  tree  building  proeess  or  they  ean  be  used  to 
test  the  tree  after  the  building  proeess  is  eomplete.  Both  eross  validation  and  independent 
data  validation  methods  were  used.  Sinee  eross  validation  uses  a  random  portion  of  all 
the  data  to  validate  the  trees,  independent  data  were  ehosen  to  test  the  decision  trees  to 
represent  a  year  of  true  verification  for  the  forecast  tool.  This  decision  tool  will  be 
placed  in  the  field  with  no  yearly  updates  to  the  trees,  so  using  an  independent  data  set 
allowed  for  an  operational  test  without  the  costs  involved  with  a  missed  forecast.  Using 
2003  data  for  validation  provided  a  better  insight  to  the  feasibility  of  decision  trees  in  the 
field  without  risking  life  or  equipment. 
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4,  Results 


a.  Introduction 

This  chapter  presents  a  summary  of  the  deeision  tools  ereated  by  the  CART 
program  to  foreeast  CG  lightning.  Four  CART  deeision  trees  were  produeed  for  eaeh  of 
the  13  loeations.  The  deeision  trees  were  developed  using  two  different  radii  and  eost 
matrixes.  Two  data  sets  were  used  in  this  researeh.  The  learning  data  set  is  from  1993  - 
2002  and  was  used  to  build  the  models.  The  test  data  set  is  from  2003  and  was  an 
independent  data  set  used  to  validate  the  models.  As  previously  mentioned,  this  researeh 
was  verified  using  the  independent  data  to  “field  test”  the  foreeast  deeision  trees.  So  it  is 
important  to  discuss  the  results  from  both  deeision  trees  sinee  2003  eould  be  an  extreme 
year.  A  tree  that  verifies  poorly  but  has  a  good  learning  seore  could  validate  well  in 
2004.  The  results  will  demonstrate  the  varying  suceess  of  the  decision  tools  for  each 
location  and  the  benefits  to  the  weather  foreeaster. 


b.  Variable  Importance 

Variable  Importanee  was  used  to  maximize  the  deeision  tool  while  redueing  the 
number  of  predictors  required  to  aehieve  the  best  results.  As  mentioned  in  chapter  3, 
variable  importanee  allows  the  user  to  quiekly  determine  the  predietors  that  supply  value 
to  the  deeision  tree.  CART  displays  the  predietors  in  order  of  relevanee  in  the  summary 
reports.  Variable  importanee  also  supplied  the  researeh  with  insight  on  whieh  variables 
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worked  best  with  eaeh  region.  Table  13  eontains  the  top  two  predietor  variables  of  eaeh 
tree  ereated  for  eaeh  loeation  foreeasted.  Based  on  the  results,  SSI,  KI,  and  LI  were  the 
top  predictors  for  the  research. 


c.  Decision  Trees 

The  decision  trees  built  in  this  research  took  advantage  of  CART  allowing  the 
user  to  input  the  importance  of  each  class.  The  cost  matrix  is  the  tool  that  allows  the  user 
to  decide  the  importance  of  correctly  forecasting  CG  lightning.  A  one  to  one  cost 
weighed  the  importance  of  correctly  forecasting  CG  lightning  and  false  alarm  rates 
equally.  A  tree  built  using  a  two  to  one  cost  matrix  expressed  the  importance  of  correctly 
forecasting  CG  lightning.  These  trees  simply  implied  that  it  was  twice  as  important  to 
not  miss  a  CG  lightning  occurrence  as  it  was  to  have  incorrectly  forecast  for  CG 
lightning  and  it  not  occur.  Fig.  3  is  an  example  of  a  decision  tree  created  by  CART.  The 
tree  was  for  within  a  25  nm  radius  of  Andrews  AFB  using  a  cost  matrix  of  two  to  one. 
The  SSI  was  the  only  predictor  used  as  a  rule  and  the  split  was  performed  at  3.66.  The 
SSI  was  slightly  higher  than  the  “accepted”  values  of  SSI  in  chapter  2.  The  higher  value 
of  SSI  could  account  for  the  over  forecasting  observed  in  the  verification  tests. 

Applying  a  cost  matrix  to  the  data  analysis  process  did  improve  the  prediction 
success  for  most  locations.  However,  as  stated  above  and  in  chapter  3,  the  higher 
successes  for  predicting  CG  lightning  increased  the  misclassification  error  for  the 
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Table  13.  Top  two  predictors  for  each  location  based  on  the  variable  importance. 
The  following  indices  are  listed  below;  Showalter  Stability  Index  (SSI),  K  Index 
(KI),  Lifted  Index  (LI),  Convective  Available  Potential  Energy  (CAPE),  Month,  and 
Severe  Weather  Threat  Index  (SWEAT). 


Location 

10  nm 

1  to  1  cost 

10  nm 

2  to  1  cost 

25  nm 

1  to  1  cost 

25  nm 

2  to  1  cost 

Andrews  AFB 

SSI  KI 

SSI  KI 

SSI  KI 

SSI  El 

Dover  AFB 

El  SSI 

SSI  El 

SSI  El 

SSI  El 

Ellsworth  AFB 

El  SSI 

El  SSI 

SSI  El 

SSI  El 

Ft  Belvoir 

SSI  KI 

SSI  KI 

SSI  KI 

SSI  KI 

Ft  Dmm 

El  CAPE 

El  SSI 

El  SSI 

El  CAPE 

Grand  Forks  AFB 

SSI  El 

SSI  El 

El  SSI 

El  SSI 

Grissom  AFB 

KI  SSI 

KI  SSI 

KI  SSI 

SSI  KI 

McGuire  AFB 

CAPE  SSI 

SSI  El 

KI  SSI 

SWEAT  SSI 

Minot  AFB 

El  SSI 

El  Month 

KI  El 

KI  El 

Offutt  AFB 

KI  SSI 

KI  SSI 

KI  SSI 

KI  SSI 

Scott  AFB 

KI  SSI 

KI  SSI 

KI  SSI 

KI  SSI 

Westover  AFB 

KI  SSI 

SSI  KI 

KI  SSI 

KI  SSI 

Wright  Patterson  AFB 

SSI  El 

SSI  KI 

SSI  KI 

SSI  KI 

non-occurrence  of  CG  lightning.  So  the  inereased  predietion  eapabilities  eame  with  the 
priee  of  increased  false  alarm  rates. 

A  problem  with  the  CART  deeision  tree  is  determining  whieh  node  holds  the 
most  important  information  and  is  the  best  tool  for  foreeasting  the  desired  outeome. 
There  are  four  probabilities  used  to  determine  the  value  of  eaeh  terminal  node  in  this 
research;  1)  total  probability  of  the  learning  tree,  2)  total  probability  of  the  test  tree,  3) 
the  within  the  terminal  node  probability  of  the  learning  tree,  and  4)  the  within  the 
terminal  node  probability  of  the  test  tree.  The  “total  probability”  (TP)  is  ealeulated  by 
adding  the  probability  of  eaeh  elass  for  the  speeific  node. 
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Node  1 
Class  =  1 
SSI 

Class  Cases  % 

0  3803  88.9 

1  477  11.1 

N  =  4280 


SSI<=  3.662  SSI>  3.662 


Terminal 

Node  1 

Class  =  1 

Class  Cases  % 

0  1785  81.2 

1  412  18.8 

Terminal 

Node  2 

Class  =  0 

Class  Cases  % 

0  2018  96.9 

1  65  3.1 

N  =  2197 

N  =  2083 

Fig  2.  A  learning  decision  tree  for  within  25  nm  radius  of  Andrews  AFB  with  a  two  to 

one  cost  matrix. 


The  classes  are:  (class  1)  CG  lightning  occurred  and  (class  0)  no  CG  lightning  occurred. 
The  probability  within  each  terminal  node  is  calculated  using  Bayes  Rule. 

This  probability  displays  how  accurate  the  prediction  is  within  each  terminal  node  and 
can  be  used  to  measure  the  strength  of  the  forecast.  The  following  equation  is  used 
calculate  total  probability  (TP): 


TP  =  P{left\class\)P{class\)  +  Pileft  classQ)P{classQ) .  (10) 


The  following  equation  is  Bayes  Rule  (Montgomery  and  Runger  2003): 


P{class\ left)  = 


P{left  class\)P{class\) 

P(left  classV)P(class\)  +  P{left  class0)P(class0) 


(11) 
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The  direction  can  be  left  or  right  depending  on  the  splitting  rules  used.  For  both 
equations,  left  is  the  direction  of  the  branch  in  the  decision  tree,  class  1  is  CG  lightning 
occurred,  and  class  0  is  CG  lightning  did  not  occur.  Next,  an  example  calculation  of  both 
probabilities  using  the  following  decision  tree  was  performed  to  verify  the  CART 
numerical  output. 

First  calculate  the  individual  portions: 

412  1 785 

P(SSI  <=  3M2\class\)  = - ,  P(SSI  <=  3M2\classO)  = - ,  and  the 

'477  '  3803 

probability  of  each  class  is  0.5. 

Now  using  equations  10  and  11: 

TP  =  (0.8637X0.5)  +  (0.4694)(0.5)  =  0.6665  ,  and 


P{class\  SSI  <=  3. 662)  = 


(0.8637X0.5) 


(0.8637)(0.5)  +  (0.4694)(0.5) 


=  0.64791. 


The  total  probability  for  terminal  node  one  is  0.6665  and  the  within  node  probability  is 
0.64791.  These  results  imply  that  there  is  a  66.65%  probability  of  finishing  in  terminal 
node  one.  Once  in  terminal  node  one,  there  is  a  64.791%  chance  of  properly  forecasting 
CG  lightning.  This  is  the  exact  result  that  CART  presented  in  the  output.  The  TP  results 
were  used  to  reduce  the  decision  trees  to  contain  only  the  relevant  rules.  If  the  TP  was 
less  than  0.01,  meaning  there  was  a  less  than  1%  probability  of  the  node  occurring,  then 
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the  node  and  it’s  aeeompanying  rules  were  removed.  Appendix  B  eontains  the  foreeast 
rules  and  their  ealeulated  probabilities  using  Bayes’  rule.  Displaying  the  probabilities 
provided  the  reader  the  probability  of  eorreetly  foreeasting  CG  lightning  for  eaeh  foreeast 
rule. 

Classieal  statistieal  methods  were  not  used  to  ereate  the  foreeast  tools;  however, 
elassieal  statisties  will  be  used  to  determine  the  value  of  the  final  deeision  trees. 
Contingeney  tables  were  ereated  to  evaluate  the  eategorieal  foreeast  results.  A 
eontingeney  table  is  a  simple  two  by  two  that  displays  the  foreeasts  and  the  observations 
in  an  easy  to  understand  method  (Wilks  1995).  Six  verifieation  tests  were  applied  to  the 
resulting  binary  foreeasts  loeated  in  the  eontingeney  tables.  Fig.  2  is  a  base  table  with  the 
box  identifiers  for  applying  to  the  formulas  from  the  eontingeney  tables.  All  the  values 
for  the  six  verifieation  equations  ean  be  found  using  Fig.  2. 


Fig  3.  A  eontingeney  table  showing  the  eorreet  loeation  for  the  results  of  binary 
foreeasts  (modified  from  Wilks  1995). 

The  hit  rate  was  the  first  verifieation  method  applied  to  the  results.  Hit  rate  is  the 
number  of  events  or  nonevents  foreeasted  eorreetly  divided  by  the  total  number  of 
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forecasts  (Wilks  1995).  The  best  hit  rate  is  a  score  of  one  and  the  worst  is  a  score  of 
zero. 

The  hit  rate  (H)  was  calculated  using  the  following  equation; 


n 


10 


where  n  is  the  total  forecasts  given  by  adding  together  all  four  boxes  in  the  table. 

The  second  method  applied  to  the  results  was  a  threat  score  (TS).  The  TS  is  a 
technique  advantageous  to  determine  when  the  number  of  positive  or  yes  events  occur 
less  frequently  than  the  nonevents  (Wilks  1995).  Since  CG  lightning  occurrence  was 
one-tenth  of  the  nonoccurrence  this  test  was  also  calculated  from  the  results.  Again 
similar  to  the  hit  rate,  a  score  of  zero  is  the  worst  and  a  score  of  one  is  the  best  possible 
score.  The  TS  was  computed  using  the  following  equation: 

TS  = - - - .  1 1 

A  +  B  +  C 


The  third  verification  tool  applied  was  the  probability  of  detection  (POD).  POD 
is  probability  the  event  would  be  forecasted  given  that  the  event  actually  occurred  (Wilks 
1995).  Perfect  forecasts  have  a  POD  of  one  and  the  worst  forecasts  have  a  POD  of  zero. 
The  following  equation  was  used  to  determine  the  POD; 
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POD  = 


A 


12 


A  +  C 

The  previous  tests  were  used  to  judge  how  good  the  forecasts  verified;  however, 
the  fourth  method  determined  how  many  forecasts  did  not  occur.  The  false-alarm  rate 
(FAR)  was  calculated  for  the  decision  trees  to  clarify  if  the  high  forecast  results  were 
obtained  by  extreme  over-forecasting.  Wilks  (1995)  presented  the  following  formula  for 
evaluating  FAR; 


FAR  = 


B 

A  +  B  ' 
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A  major  difference  of  FAR  over  the  previous  methods  is  smaller  values  are  better  with 
zero  as  the  best  score  and  one  the  worst  score. 

The  Bias  was  the  fifth  method  used  to  verify  the  results.  Bias  compares  the 
average  of  the  observations  and  forecasts  to  determine  a  ratio  (Wilks  1995).  The 
resulting  ratio  allows  conclusions  to  be  made  about  the  forecast  model.  A  perfect  model 
has  a  Bias  of  one.  If  a  model  has  a  Bias  greater  than  one,  it  is  said  to  over-forecast  the 
event  since  the  model  forecast  the  event  more  than  the  event  occurred.  A  Bias  less  than 
one  describes  a  model  that  under-forecasts  the  events.  Bias  was  calculated  using  the 
following  equation: 


Bias  = 


A  +  B 
A  +  C' 


14 
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A  Kuipers  Skill  Score  (KSS)  was  the  last  measure  used  to  determine  the  value  of 
the  forecast  model.  A  skill  score  is  a  scalar  measure  of  how  well  the  foreeast  model 
performed  (Wilks  1995).  Most  weather  foreeast  models  are  eompared  with  some  type  of 
elimatology  to  determine  the  benefits  of  ehoosing  the  partieular  model.  So,  the  KSS  was 
ehosen  for  this  research  because  the  random  reference  forecasts  in  the  KSS  formula 
eontain  a  marginal  distribution  equal  to  elimatology  (Wilks  1995).  The  equation  used  to 
determine  the  KKS  was: 


KSS  = 


AD-BC 
{A  +  C){B  +  Dy 


15 


A  score  of  one  is  a  perfect  forecast,  a  score  of  zero  is  a  random  forecast,  and  a  negative 
score  is  a  foreeast  that  is  inferior  to  a  random  forecast. 

Table  14  is  a  eomplete  eontingency  table  with  verifieation  of  the  model  results  for 
within  25  nm  of  Andrews  AFB  and  a  eost  matrix  of  two  to  one  (using  the  foreeast 
deeision  tree  in  Fig.  3).  The  data  used  to  build  this  model  were  for  1993  -  2002.  Table 
15  is  the  same  as  table  14  except  the  tests  were  performed  on  the  verifieation  data  from 
2003. 

The  verifieation  tests  were  performed  on  the  both  decision  trees  to  determine  their 
value  as  a  forecast  tool.  There  were  822  cases  of  CG  lightning  during  the  lOyear  period. 
The  decision  tree  correctly  classified  736  of  those  occurrences.  This  gave  the  tree  a  POD 
of  89%,  however,  the  model  over  foreeasts  which  can  be  seen  the  high  FAR  of  0.68.  The 
over  foreeast  was  apparent  with  a  Bias  of  2.8. 
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Table  14.  Model  results  for  Andrews  AFB  25  nm  (cost  two  to  one) 


Observed 

Forecasted 

YES 

NO 

HR 

TS 

POD 

FAR 

Bias 

KSS 

YES 

736 

1598 

61% 

0.30 

0.89 

0.68 

2.8 

0.43 

NO 

86 

1860 

Table  15.  Verification  results  for  Andrews  AFB  25 

nm  (cost  two  to  one) 

Observed 

Forecasted 

YES  NO 

HR 

TS 

POD  FAR  Bias 

KSS 

YES  109 

NO  2 

142 

175 

66% 

0.43 

0.98  0.57  2.3 

0.53 

The  first  five  verification  tests  applied  to  the  results  gave  mixed  results  so  a  skill 
score  technique  was  calculated  to  determine  the  usefulness  of  the  decision  tree.  A  KSS  of 
0.43  showed  the  tree  his  was  an  improvement  over  a  random  forecast.  The  verification 
tree,  based  on  2003  data,  performed  better  as  seen  by  the  numbers  in  Table  15.  There 
were  1 1 1  Cg  lightning  occurrences.  The  decision  tree  when  applied  to  2003  had  a  POD 
of  98%  and  a  FAR  of  0.57.  The  bias  of  2.3  was  lower  than  the  2.8  of  the  base  tree.  A 
KSS  of  0.53  demonstrated  that  the  model  did  really  well  when  compared  to  random 
forecasts.  Complete  contingency  tables  with  results  from  the  six  verification  tests  can  be 
found  in  Appendix  A. 
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5.  Conclusions  and  Recommendations 


a.  Conclusions 

Thunderstorms  are  weather  phenomena  that  affeet  all  of  North  Ameriea.  A  major 
produet  of  these  thunderstorms,  eloud-to-ground  (CG)  lightning  is  extremely  important  to 
the  weather  and  Air  Foree  eommunities.  The  world’s  inereasing  dependenee  on 
teehnology  and  energy  has  inereased  the  importanee  for  the  weather  eommunity  to 
aehieve  the  ability  to  prediet  the  oeeurrenee  of  thunderstorms  and  CG  lightning.  The 
Department  of  Defense  (DoD)  and  the  Federal  Aviation  Administration  (FAA)  are 
extremely  eoneemed  with  CG  lightning  due  to  the  risk  to  personnel  and  the  eost  of 
replaeing  damaged  equipment.  With  a  single  aireraft  eosting  millions  of  dollars,  the  need 
for  better  thunderstorm  and  lightning  warnings  is  beeoming  more  erueial  than  ever. 

The  15th  Operational  Weather  Squadron  (OWS)  loeated  at  Seott  AFB,  Illinois  has 
the  responsibility  of  foreeasting  weather  12  aetive  duty  and  17  Reserve  and  National 
Guard  military  installations  aeross  the  North  Central  and  Northeastern  United  States. 

The  15th  OWS  made  a  request  for  a  reliable  foreeast  tool  to  prediet  CG  lightning.  To 
fulfill  their  request,  foreeast  deeision  tools  were  ereated  using  a  Classifieation  and 
Regression  Tree  (CART)  data  analysis  program. 

Venzke  (2001)  developed  a  similar  method  of  applying  stability  indiees  eomputed 
from  upper  air  soundings  to  determine  the  probability  of  CG  lightning  for  a  region  within 
a  50  nautieal-mile  (nm)  radius  surrounding  the  upper  air  stations  in  the  Midwest. 
However,  Venzke  did  not  apply  the  CART  data  analysis  program  to  his  work.  Also, 
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these  loeations  were  geographieally  separated  from  the  upper  air  stations,  in  some  eases 
by  over  100  miles.  The  primary  purpose  of  this  researeh  was  to  provide  the  15**^  OWS 
with  a  CG  lightning  foreeast  tool  using  predietors  that  were  readily  available  to  the 
foreeasters.  Foreeasters  at  most  military  installations  do  not  have  the  benefit  of  on-site 
upper  air  stations  so,  this  researeh  used  the  resourees  available  to  the  military  operational 
foreeasters  in  an  effort  to  determine  a  predietor  for  CG  lightning  for  within  25  nm  and 
within  10  nm  of  eaeh  loeation.  Knowledge  learned  from  both  Venzke  (2001)  and  Sahu 
and  Singh  (1999)  was  implemented  into  the  proeess  to  determine  the  best  possible 
methods  for  developing  the  CG  lightning  foreeast  deeision  tools. 

The  oeeurrenee  of  CG  lightning  for  the  North  Central  and  Northeast  regions  is 
eentered  on  the  summer  months,  therefore  this  study  foeused  on  a  data  set  eontaining  the 
warmer  months.  A  10  year  data  set  from  1993  to  2002,  using  only  the  months  Mareh 
through  September  was  determined  to  represent  the  region  of  interest.  To  validate  the 
deeision  model,  an  independent  year  was  ehosen  as  the  verifieation  data.  2003  data  were 
applied  to  the  model  to  establish  the  validity  of  using  the  model  as  a  foreeast  tool  in  the 
field.  The  CG  lightning  data  were  eolleeted  from  the  NLDN.  Two  eriteria  were  used, 
within  25  nm  and  within  10  nm  of  eaeh  loeation.  The  upper  air  sites  were  seleeted  to  best 
represent  the  eonditions  for  eaeh  loeation.  The  stability  indiees  were  ealeulated  and 
eombined  with  the  lightning  data.  Later  surfaee  data  was  added  to  ereate  a  larger  list  of 
predietors. 

CART  was  the  tool  used  in  this  researeh  to  ereate  foreeast  deeision  aides  for  the 
loeations  within  the  15*  AOR.  The  CART  data  analysis  program  developed  deeision 
rules  that  were  easy  to  follow  and  ean  be  implemented  into  an  automated  system.  CART 
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was  applied  to  a  modified  proeess  similar  to  the  one  performed  by  Venzke  (2001)  and 
ideas  for  new  predietors  were  taken  from  the  works  of  Sahu  and  Singh  (1999).  CART 
allowed  for  many  user  interaetions  into  the  foreeast  model.  Two  eost  matriees  were  used 
to  emphasize  the  importanee  of  eorreetly  foreeast  CG  lightning.  Priors  data  was  ehosen 
to  assign  the  probabilities  to  the  data  so  that  the  oeeurrenee  of  CG  lightning  was  as 
probable  as  the  non-oeeurrenee.  This  prevented  CART  from  foeusing  on  the  non- 
oceurrenee.  The  Gini  splitting  method  was  ehosen  to  make  the  splits  in  the  deeision 
trees.  Independent  testing  was  seleeted  over  eross  validation  although  both  methods 
were  used  to  validate  the  models.  The  independent  data  allowed  for  a  trial  field  test 
without  the  impaet  of  missed  foreeasts.  The  verifieation  using  2003  data  provided  insight 
on  the  true  value  of  the  CART  deeision  trees  as  true  foreeast  tools. 

Four  deeision  trees  were  produeed  for  eaeh  loeation  using  the  period  of  reeord 
from  Mareh  through  September,  1993  to  2002.  CART  eompared  the  upper  air  stability 
indiees  and  surfaee  data  at  12-hour  intervals  with  CG  lightning  data  oeeurring  within  the 
next  12  hours  to  determine  predietion  rules.  Onee  the  deeision  trees  were  ereated,  the 
data  from  2003  were  used  to  independently  verify  of  the  deeision  trees.  The  variable 
importanee  was  applied  to  eaeh  deeision  tree  ereated  and  the  final  52  trees  were  aeeepted 
and  tested  for  using  statistieal  verifieation  methods.  The  top  predictors  were  SSI,  LI  and 
KI.  They  were  listed  as  the  top  two  predictors  for  nearly  every  decision  tree  built  (see 
table  13).  A  surprise  predictor  variable  surfaced  in  certain  regions  of  the  15*’^.  CART 
used  the  month  as  a  predictor  for  Ellsworth  AFB,  Grand  Forks  AFB,  Grissom  AFB, 

Minot  AFB,  Offutt  AFB,  and  Scott  AFB.  These  six  were  the  western  most  locations  in 
the  research.  Also  for  Minot  AFB,  no  decision  ruled  allowed  for  the  forecast  of  CG 
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lightning  in  the  months  of  March  and  April.  After  reviewing  the  data  it  was  determined 


this  was  not  an  error.  In  1 1  years  there  were  zero  occurrences  of  CG  lighting  within 
25nm  for  the  month  of  March.  There  were  only  eight  total  Cg  lightning  occurrences 
within  25  nm  in  April.  The  use  of  month  as  a  predictor  proved  that  the  time  of  year  is 
critical  for  this  region.  Also,  the  Minot  AFB  decision  tool  cannot  be  used  to  forecast  CG 
lightning  in  March  or  April.  Further  investigations  could  be  done  on  these  four  locations 
to  see  if  a  month  dependent  list  of  stability  indices  could  be  created,  however,  that  was 
beyond  the  scope  of  this  research.  The  forecast  rules  were  extracted  from  the  final  52 
decision  trees  and  placed  into  tables  (see  Appendix  B). 

The  results  achieved  were  higher  than  anticipated  in  most  aspects.  The  overall 
KSS  score  was  from  0.31  to  0.70  and  this  showed  the  decision  trees  had  some 
improvement  over  random  forecasts.  Also,  the  POD  was  over  70%  in  48  of  52  decision 
trees.  However,  as  positive  as  those  results  were,  the  FAR  was  extremely  high  ranging 
from  0.43  to  as  high  0.89.  Also,  all  bias  scores  were  above  one  for  every  decision  tree 
which  showed  the  decision  trees  had  a  tendency  to  over  forecasted  CG  lightning.  The 
entire  results  of  the  statistical  verification  test  can  be  found  in  Appendix  A. 


b.  Recommendations 

The  decision  trees  developed  by  CART  provided  valuable  insight  in  the 
forecasting  of  weather  parameters  and  could  provide  a  possible  avenue  for  future 
research.  Any  weather  phenomena  can  theoretically  be  predicted  if  the  right  predictors 
are  available.  As  CART  becomes  a  more  popular  and  proven  tool,  more  research  should 
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be  done  to  test  further  CART  applieations  into  weather  foreeasting.  Future  CART 
deeision  trees  should  use  the  guidanee  and  shorteomings  provided  by  this  and  other 
previous  researeh  to  further  enhanee  the  predietive  outeome  of  weather  deeision  models. 

Although  the  results  in  this  researeh  provided  promising  values  for  a  CG  lightning 
deeision  tool,  it  is  not  reeommended  to  use  these  deeision  tools  as  a  stand  alone  CG 
lightning  foreeast  tool.  It  is  also  not  reeommended  to  apply  these  rules  without  using  the 
speeifle  sites  paired  with  the  eorreet  upper  air  site.  A  problem  with  this  tool  was  it 
prediets  the  probability  that  CG  lightning  will  oeeur  in  the  next  12  hours  and  not  a 
speeifle  time  period  within  the  12  hours.  The  tool  does  not  aeeount  for  any  parameters 
exeept  the  ones  used  in  the  deeision  tree,  so  this  tool  should  never  be  used  alone  in  the 
deeision  proeess  of  foreeasting  CG  lightning.  The  foreeast  rules  should  be  used  in 
eonjunetion  with  foreeaster  knowledge,  numerieal  weather  predietion  models  and  other 
tools  to  ensure  an  aeeurate  foreeast. 

A  major  shortfall  of  the  method  used  in  this  researeh  was  the  12  hour  time  bloeks 
of  data.  The  predietion  rates  are  based  on  the  ability  of  CART  to  eorreetly  elassify  the 
oeeurrenee  of  CG  lightning  anytime  during  the  entire  12  hour  period.  One 
reeommendation  for  further  researeh  is  to  use  hourly  surfaee  data  and  CG  lightning  data 
to  develop  foreeast  aides  that  have  a  stronger  impaet  on  weather  foreeasts. 

Another  reeommendation  would  be  to  use  model  data  eombined  with  CART  to 
prediet  CG  lightning.  The  same  proeedures  eould  be  followed  exeept  replaeing  upper  air 
stability  indiees  and  other  predietors  with  predietors  from  the  model.  For  example,  use 
the  eurrent  surfaee  temperature,  3-hour  foreeast  temperature  and  3-hour  dew  point  as 
predietors  to  develop  a  better  deeision  tool.  This  could  allow  for  three,  six,  nine,  12- 
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hour,  or  even  longer  CG  lightning  foreeast.  This  would  help  eliminate  the  uneertainty  in 
oeeurrenee  assoeiated  with  the  method  in  this  research. 
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Appendix  A:  Two  by  Two  Matrices  with  Results 


This  appendix  presents  the  eomplete  list  of  two  by  two  matriees  and  the 
calculated  verification  test  results.  The  CART  analysis  program  was  used  to  data  mine 
for  the  13  locations  in  the  15  AOR.  The  locations  were  combined  with  a  specific  upper 
air  station  that  was  considered  representative  of  the  location  (see  table  12  for  the  correct 
station).  The  data  used  in  the  building  of  the  model  and  the  resulting  decision  trees  were 
from  1993  to  2002.  Verification  of  the  model  and  resulting  decision  trees  was 
accomplished  with  independent  data  from  2003.  This  method  was  chosen  to  test  the 
benefits  as  a  stand  along  forecast  tool.  Once  in  place  in  the  field,  the  decision  aide  will 
not  be  update  annually  so  it  was  important  to  verify  it  as  forecast  tool  and  not  just  a 
research  tool. 

The  contingency  tables  were  created  to  display  the  results  from  the  CART  data 
analysis.  Verification  test  were  calculated  on  the  contingency  tables  and  all  were 
displayed  as  a  single  results  table.  Each  table  contains  an  observed  versus  forecast  two 
by  two  matrix,  the  hit  rate  (HR),  a  threat  score  (TS),  the  probability  of  detection  (POD), 
the  false-alarm  rate  (FAR),  the  bias,  and  the  Kuipers  skill  score  (KSS)  (Wilks  1995).  For 
further  information  and  the  equations  used  for  the  calculations  of  the  tests,  see  chapter  3 
section  c. 

Eight  result  tables  are  provided  for  each  location:  1)  model  results  for  a  10  nm 
radius  with  a  one  to  one  cost,  2)  verification  results  for  a  10  nm  radius  with  a  one  to  one 
cost,  3)  model  results  for  a  10  nm  radius  with  a  two  to  one  cost,  4)  verification  results  for 
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a  10  nm  radius  with  a  two  to  one  cost  5)  model  results  for  a  25  nm  radius  with  a  one  to 
one  cost,  6)  verification  results  for  a  25  nm  radius  with  a  one  to  one  cost,  7)  model  results 
for  a  25  nm  radius  with  a  two  to  one  cost,  and  8)  verification  results  for  a  25  nm  radius 
with  a  two  to  one  cost. 


Al.  Andrews  AFB 


Table  Al.  Model  results  for  Andrews  AFB  10  nm  (cost  one  to  one) 


Forecasted 

Observed 

HR 

TS 

POD 

FAR 

Bias 

KSS 

YES 

NO 

YES 

371 

1343 

66% 

0.20 

0.78 

0.78 

3.6 

0.42 

NO 

106 

2460 

Table  A2.  Verification  results  for  Andrews  AFB  10  nm  (cost  one  to  one) 


Forecasted 

Observed 

HR 

TS 

POD 

FAR 

Bias 

KSS 

YES 

NO 

YES 

63 

124 

69% 

0.32 

0.90 

0.66 

2.7 

0.55 

NO 

7 

234 

Table  A3.  Model  results  for  Andrews  AFB  10  nm  (cost  two  to  one) 


Forecasted 

Observed 

HR 

TS 

POD 

FAR 

Bias 

KSS 

YES 

NO 

YES 

412 

1785 

57% 

0.18 

0.96 

0.81 

4.6 

0.39 

NO 

65 

2018 

59 


Table  A4.  Verification  results  for  Andrews  AFB  10  nm  (cost  two  to  one) 


Observed 

HD 

DAD 

ITCC 

r  Ui CCaSlCQ 

YES 

NO 

xlJx 

1  o 

X  ULI 

r  Jx 

DlaS 

YES 

68 

163 

^1  0/. 

n  9Q 

n  Q7 

n  71 

n 

NO 

2 

195 

01  /o 

u.zy 

\j,y  / 

U.  / 1 

Table  A5.  Model  results  for  Andrews  AFB  25  nm  (cost  one  to  one) 


Observed 

HD 

DC 

DAD 

ircc 

r  or CCaSlcQ 

YES 

NO 

xlJv 

1  o 

X 

r  Jx 

IxlaS 

YES 

652 

1000 

770/. 

A  7/; 

A  7Q 

A 

7  A 

A  ^A 

NO 

170 

2458 

/  J)  /o 

U.  J>U 

\j.  /y 

U.0 1 

z.u 

KJ.DKJ 

Table  A6.  Verification  results  for  Andrews  AFB  25  nm  (cost  one  to  one) 


Observed 

HD 

DC 

DAD 

ITCC 

r  or CCaSlCQ 

YES 

NO 

FlJx 

1  O 

IlKJIJ 

r  ix  Jx 

IxlSiS 

1x00 

YES 

100 

74 

QAO/. 

A 

A  QA 

A  /I7 

1  ^ 

A 

NO 

11 

243 

oU  /o 

U.H-J 

1 .0 

U.O  / 

Table  A7.  Model  results  for  Andrews  AFB  25  nm  (cost  two  to  one) 


Observed 

HD 

DC 

DAD 

ircc 

r  Ox  CCSiSlCQ 

YES 

NO 

JtUx 

1  O 

X  ULI 

r  /\  lx 

IxlaS 

Jxoo 

YES 

736 

1598 

0/. 

A  7A 

A  QQ 

7  8 

A  /I7 

NO 

86 

1860 

01  /o 

U. 

\j.oy 

U.Oo 

jL.O 

Table  A8.  Verification  results  for  Andrews  AFB  25  nm  (cost  two  to  one) 


Observed 

HD 

DC 

DAD 

ircc 

r  Ox  CCaSlCQ 

YES 

NO 

xiJx 

1  O 

SlKJIJ 

r  ix  lx 

IxlaS 

1x00 

YES 

109 

142 

A  /I7 

A  QQ 

A  ^7 

7  7 

A  "^7 

NO 

2 

175 

00  /o 

U.H-J 

U.yo 

U.7  / 

jL.J 

U.77 

60 


A2.  Dover  AFB 


Table  A9.  Model  results  for  Dover  AFB  10  nm  (cost  one  to  one) 


Forecasted 

Observed 

HR 

TS 

POD 

FAR 

Bias 

KSS 

YES 

NO 

YES 

350 

1292 

68% 

0.20 

0.81 

0.79 

3.8 

0.47 

NO 

82 

2556 

Table  AlO.  Verification  results  for  Dover  AFB  10  nm  (cost  one  to  one) 


Forecasted 

Observed 

HR 

TS 

POD 

FAR 

Bias 

KSS 

YES 

NO 

YES 

59 

111 

72% 

0.33 

0.89 

0.65 

2.6 

0.59 

NO 

7 

251 

Table  All.  Model  results  for  Dover  AFB  10  nm  (cost  two  to  one) 


Forecasted 

Observed 

HR 

TS 

POD 

FAR 

Bias 

KSS 

YES 

NO 

YES 

394 

1780 

58% 

0.18 

0.91 

0.82 

5.0 

0.45 

NO 

38 

2068 

Table  A12.  Verification  results  for  Dover  AFB  10  nm  (cost  two  to  one) 


Forecasted 

Observed 

HR 

TS 

POD 

FAR 

Bias 

KSS 

YES 

NO 

YES 

64 

168 

60% 

0.27 

0.97 

0.72 

3.5 

0.51 

NO 

2 

194 

61 


Table  A13.  Model  results  for  Dover  AFB  25  nm  (cost  one  to  one) 


Forecasted 

Observed 

HR 

TS 

POD 

FAR 

Bias 

KSS 

YES 

NO 

YES 

632 

1171 

70% 

0.33 

0.83 

0.65 

2.4 

0.50 

NO 

129 

2348 

Table  A14.  Verification  results  for  Dover  AFB  25  nm  (cost  one  to  one) 


Forecasted 

Observed 

HR 

TS 

POD 

FAR 

Bias 

KSS 

YES 

NO 

YES 

93 

99 

75% 

0.46 

0.90 

0.52 

1.9 

0.60 

NO 

10 

226 

Table  A15.  Model  results  for  Dover  AFB  25  nm  (cost  two  to  one) 


Forecasted 

Observed 

HR 

TS 

POD 

FAR 

Bias 

KSS 

YES 

NO 

YES 

670 

1501 

63% 

0.30 

0.88 

0.69 

2.9 

0.45 

NO 

91 

2018 

Table  A 16.  Verification  results  for  Dover  AFB  25  nm  (cost  two  to  one) 


Forecasted 

Observed 

HR 

TS 

POD 

FAR 

Bias 

KSS 

YES 

NO 

YES 

96 

136 

67% 

0.40 

0.93 

0.59 

2.3 

0.51 

NO 

7 

189 

62 


A3.  Ellsworth  AFB 


Table  All.  Model  results  for  Ellsworth  AFB  10  nm  (cost  one  to  one) 


Forecasted 

Observed 

HR 

TS 

POD 

FAR 

Bias 

KSS 

YES 

NO 

YES 

463 

1120 

71% 

0.27 

0.78 

0.71 

2.7 

0.48 

NO 

131 

2566 

Table  A18.  Verification  results  for  Ellsworth  AFB  10  nm  (cost  one  to  one) 


Forecasted 

Observed 

HR 

TS 

POD 

FAR 

Bias 

KSS 

YES 

NO 

YES 

40 

116 

68% 

0.22 

0.63 

0.74 

2.5 

0.32 

NO 

23 

249 

Table  A19.  Model  results  for  Ellsworth  AFB  10  nm  (cost  two  to  one) 


Forecasted 

Observed 

HR 

TS 

POD 

FAR 

Bias 

KSS 

YES 

NO 

YES 

564 

1558 

63% 

0.26 

0.95 

0.55 

3.6 

0.53 

NO 

30 

2128 

Table  A20.  Verification  results  for  Ellsworth  AFB  10  nm  (cost  two  to  one) 


Forecasted 

Observed 

HR 

TS 

POD 

FAR 

Bias 

KSS 

YES 

NO 

YES 

50 

178 

55% 

0.21 

0.79 

0.78 

3.6 

0.31 

NO 

13 

187 

63 


Table  All.  Model  results  for  Ellsworth  AFB  25  nm  (cost  one  to  one) 


Forecasted 

Observed 

HR 

TS 

POD 

FAR 

Bias 

KSS 

YES 

NO 

YES 

882 

1053 

71% 

0.41 

0.81 

0.54 

1.8 

0.48 

NO 

205 

2140 

Table  All.  Verification  results  for  Ellsworth  AFB  25  nm  (cost  one  to  one) 


Forecasted 

Observed 

HR 

TS 

POD 

FAR 

Bias 

KSS 

YES 

NO 

YES 

88 

102 

69% 

0.40 

0.75 

0.54 

1.6 

0.42 

NO 

29 

209 

Table  A23.  Model  results  for  Ellsworth  AFB  25  nm  (cost  two  to  one) 


Forecasted 

Observed 

HR 

TS 

POD 

FAR 

Bias 

KSS 

YES 

NO 

YES 

1003 

1300 

68% 

0.42 

0.92 

0.56 

2.1 

0.52 

NO 

84 

1893 

Table  A24.  Verification  results  for  Ellsworth  AFB  25  nm  (cost  two  to  one) 


Forecasted 

Observed 

HR 

TS 

POD 

FAR 

Bias 

KSS 

YES 

NO 

YES 

103 

130 

66% 

0.42 

0.88 

0.56 

2.0 

0.46 

NO 

14 

181 

A4.  Ft  Belvoir 


64 


Table  A25.  Model  results  for  Ft  Belvoir  10  nm  (cost  one  to  one) 


Observed 

HD 

DAD 

ITCC 

r  or  CCSiSlCQ 

YES 

NO 

XlJv 

1  o 

IlKJIJ 

r  Jv 

DlaS 

YES 

413 

1358 

n  99 

A  Q9 

n  77 

A  /!/; 

NO 

90 

2419 

00  /o 

U.Z.Z. 

Kj.OjL 

U.  /  / 

•9*9 

U.H-O 

Table  A26.  Verification  results  for  Ft  Belvoir  10  nm  (cost  one  to  one) 


Observed 

HD 

DC 

DAD 

ircc 

r  or  CCaSlCQ 

YES 

NO 

xlJx 

1  o 

X 

r  Jv 

DlaS 

YES 

66 

132 

A  99 

A  Q/l 

A 

9  8 

A  ^7 

NO 

4 

226 

Oo  /o 

U.99 

U.O  / 

z.o 

U.9  / 

Table  A27.  Model  results  for  Ft  Belvoir  10  nm  (cost  two  to  one) 


Observed 

HD 

DC 

DAD 

ITCC 

r  or CCaSlCQ 

YES 

NO 

xlJx 

1  O 

X 

r  /\  Jx 

IxlSiS 

YES 

427 

1720 

A  1  Q 

A 

A  QA 

/I  9 

A  9Q 

NO 

76 

2057 

9 o  /o 

U.  1  y 

U.09 

U.OU 

H-.9 

U.9!7 

Table  A28.  Verification  results  for  Ft  Belvoir  10  nm  (cost  two  to  one) 


Observed 

HD 

DC 

DAD 

ITCC 

r  OxCCaSlCQ 

YES 

NO 

xiJx 

1  o 

X  \JLI 

r  /\  Jx 

DlSiS 

Jxoo 

YES 

69 

159 

^90/. 

A  9A 

A  QQ 

A  7A 

9  9 

A 

NO 

1 

199 

09  /o 

U.9  U 

\j,yy 

U.  /  U 

9.9 

U.9‘H' 

65 


Table  A29.  Model  results  for  Ft  Belvoir  25  nm  (cost  one  to  one) 


Forecasted 

Observed 

HR 

TS 

POD 

FAR 

Bias 

KSS 

YES 

NO 

YES 

670 

1056 

71% 

0.35 

0.79 

0.61 

2.0 

0.48 

NO 

181 

2373 

Table  A30.  Verification  results  for  Ft  Belvoir  25  nm  (cost  one  to  one) 


Forecasted 

Observed 

HR 

TS 

POD 

FAR 

Bias 

KSS 

YES 

NO 

YES 

101 

99 

74% 

0.47 

0.88 

0.50 

1.7 

0.56 

NO 

14 

214 

Table  A3 1.  Model  results  for  Ft  Belvoir  25  nm  (cost  two  to  one) 


Forecasted 

Observed 

HR 

TS 

POD 

FAR 

Bias 

KSS 

YES 

NO 

YES 

729 

1445 

63% 

0.32 

0.86 

0.66 

2.6 

0.44 

NO 

122 

1984 

Table  A32.  Verification  results  for  Ft  Belvoir  25  nm  (cost  two  to  one) 


Forecasted 

Observed 

HR 

TS 

POD 

FAR 

Bias 

KSS 

YES 

NO 

YES 

107 

125 

69% 

0.45 

0.93 

0.54 

2.0 

0.53 

NO 

8 

188 

66 


A5.  Ft  Drum 


Table  A3  3.  Model  results  for  Ft  Drum  10  nm  (cost  one  to  one) 


Forecasted 

Observed 

HR 

TS 

POD 

FAR 

Bias 

KSS 

YES 

NO 

YES 

300 

1212 

71% 

0.19 

0.87 

0.80 

4.4 

0.56 

NO 

45 

2723 

Table  A34.  Verification  results  for  Ft  Drum  10  nm  (cost  one  to  one) 


Forecasted 

Observed 

HR 

TS 

POD 

FAR 

Bias 

KSS 

YES 

NO 

YES 

24 

110 

73% 

0.17 

0.86 

0.89 

4.8 

0.58 

NO 

4 

290 

Table  A3  5.  Model  results  for  Ft  Drum  10  nm  (cost  two  to  one) 


Forecasted 

Observed 

HR 

TS 

POD 

FAR 

Bias 

KSS 

YES 

NO 

YES 

327 

1383 

67% 

0.19 

0.95 

0.81 

5.0 

0.60 

NO 

18 

2552 

Table  A36.  Verification  results  for  Ft  Drum  10  nm  (cost  two  to  one) 


Forecasted 

Observed 

HR 

TS 

POD 

FAR 

Bias 

KSS 

YES 

NO 

YES 

25 

148 

65% 

0.14 

0.89 

0.86 

6.2 

0.52 

NO 

3 

252 

67 


Table  A3  7.  Model  results  for  Ft  Drum  25  nm  (cost  one  to  one) 


Forecasted 

Observed 

HR 

TS 

POD 

FAR 

Bias 

KSS 

YES 

NO 

YES 

584 

892 

78% 

0.38 

0.93 

0.60 

2.3 

0.68 

NO 

46 

2758 

Table  A3  8.  Verification  results  for  Ft  Drum  25  nm  (cost  one  to  one) 


Forecasted 

Observed 

HR 

TS 

POD 

FAR 

Bias 

KSS 

YES 

NO 

YES 

42 

94 

75% 

0.28 

0.76 

0.69 

2.5 

0.51 

NO 

13 

279 

Table  A3  9.  Model  results  for  Ft  Drum  25  nm  (cost  two  to  one) 


Forecasted 

Observed 

HR 

TS 

POD 

FAR 

Bias 

KSS 

YES 

NO 

YES 

578 

1500 

64% 

0.27 

0.92 

0.72 

3.3 

0.51 

NO 

52 

2150 

Table  A40.  Verification  results  for  Ft  Drum  25  nm  (cost  two  to  one) 


Forecasted 

Observed 

HR 

TS 

POD 

FAR 

Bias 

KSS 

YES 

NO 

YES 

50 

154 

63% 

0.24 

0.91 

0.75 

3.7 

0.50 

NO 

5 

219 

68 


A6.  Grand  Forks 


Table  A41.  Model  results  for  Grand  Forks  AFB  10  nm  (cost  one  to  one) 


Forecasted 

Observed 

HR 

TS 

POD 

FAR 

Bias 

KSS 

YES 

NO 

YES 

401 

1271 

70% 

0.24 

0.93 

0.76 

3.9 

0.60 

NO 

30 

2578 

Table  A42.  Verification  results  for  Grand  Forks  AFB  10  nm  (cost  one  to  one) 


Forecasted 

Observed 

HR 

TS 

POD 

FAR 

Bias 

KSS 

YES 

NO 

YES 

31 

117 

71% 

0.20 

0.78 

0.79 

3.7 

0.47 

NO 

9 

271 

Table  A43.  Model  results  for  Grand  Forks  AFB  10  nm  (cost  two  to  one) 


Forecasted 

Observed 

HR 

TS 

POD 

FAR 

Bias 

KSS 

YES 

NO 

YES 

397 

1372 

67% 

0.22 

0.92 

0.78 

4.1 

0.56 

NO 

34 

2477 

Table  A44.  Verification  results  for  Grand  Forks  AFB  10  nm  (cost  two  to  one) 


Forecasted 

Observed 

HR 

TS 

POD 

FAR 

Bias 

KSS 

YES 

NO 

YES 

32 

133 

67% 

0.18 

0.80 

0.81 

4.1 

0.46 

NO 

8 

255 

69 


Table  A45.  Model  results  for  Grand  Forks  AFB  25  nm  (cost  one  to  one) 


Forecasted 

Observed 

HR 

TS 

POD 

FAR 

Bias 

KSS 

YES 

NO 

YES 

608 

1028 

73% 

0.35 

0.84 

0.63 

2.3 

0.55 

NO 

118 

2526 

Table  A46.  Verification  results  for  Grand  Forks  AFB  25  nm  (cost  one  to  one) 


Forecasted 

Observed 

HR 

TS 

POD 

FAR 

Bias 

KSS 

YES 

NO 

YES 

46 

100 

66% 

0.28 

0.71 

0.68 

2.2 

0.43 

NO 

19 

263 

Table  A47.  Model  results  for  Grand  Forks  AFB  25  nm  (cost  two  to  one) 


Forecasted 

Observed 

HR 

TS 

POD 

FAR 

Bias 

KSS 

YES 

NO 

YES 

706 

1842 

56% 

0.27 

0.97 

0.72 

3.5 

0.45 

NO 

20 

1712 

Table  A48.  Verification  results  for  Grand  Forks  AFB  25  nm  (cost  two  to  one) 


Forecasted 

Observed 

HR 

TS 

POD 

FAR 

Bias 

KSS 

YES 

NO 

YES 

64 

188 

56% 

0.25 

0.98 

0.75 

3.9 

0.47 

NO 

1 

175 

A7.  Grissom  AFB 


70 


Table  A49.  Model  results  for  Grissom  AFB  10  nm  (cost  one  to  one) 


Observed 

HD 

DAD 

IZCC 

r  or  CCSiSlCQ 

YES 

NO 

XlJv 

1  o 

IlKJIJ 

r  Jv 

DlaS 

YES 

506 

1469 

A  0/1 

A  Q1 

A  7/1 

A  A  1 

NO 

120 

2185 

UJ>  /o 

U.0 1 

U.  / 

0  .z 

Table  A50.  Verification  results  for  Grissom  AFB  10  nm  (cost  one  to  one) 


Observed 

HD 

DC 

DAD 

IZCC 

r  Ui  CCaSlCQ 

YES 

NO 

xlJx 

1  o 

X 

r  Jv 

DlaS 

YES 

42 

102 

7A0/. 

A  7/1 

A  /;a 

A  71 

7  1 

A  77 

NO 

28 

256 

/  U  /o 

u.ou 

U.  / 1 

Z.  1 

U.7Z 

Table  A51.  Model  results  for  Grissom  AFB  10  nm  (cost  two  to  one) 


Observed 

HD 

DC 

DAD 

IZCC 

r  or CCaSlCQ 

YES 

NO 

xlJx 

1  O 

X 

r  /\  Jx 

IxlSiS 

YES 

599 

1898 

A  7/1 

A 

A  7/; 

/I  A 

A  AA 

NO 

27 

1756 

77  /o 

u.yo 

U.  /  0 

H-.U 

Table  A52.  Verification  results  for  Grissom  AFB  10  nm  (cost  two  to  one) 


Observed 

HD 

DC 

DAD 

IZCC 

r OxCCaSlCQ 

YES 

NO 

xiJv 

1  o 

i 

r  /\  Jx 

DlSiS 

Jxoo 

YES 

58 

152 

/;7oz 

A  7/; 

A  Q7 

A  77 

7  A 

A  /lA 

NO 

12 

206 

UZ  /O 

u.zo 

U.o7 

u.  /z 

7  .U 

U.H-U 

71 


Table  A53.  Model  results  for  Grissom  AFB  25  nm  (cost  one  to  one) 


Forecasted 

Observed 

HR 

TS 

POD 

FAR 

Bias 

KSS 

YES 

NO 

YES 

807 

1488 

61% 

0.33 

0.83 

0.65 

2.4 

0.38 

NO 

163 

1822 

Table  A54.  Verification  results  for  Grissom  AFB  25  nm  (cost  one  to  one) 


Forecasted 

Observed 

HR 

TS 

POD 

FAR 

Bias 

KSS 

YES 

NO 

YES 

72 

93 

70% 

0.36 

0.67 

0.56 

1.5 

0.38 

NO 

35 

228 

Table  A55.  Model  results  for  Grissom  AFB  25  nm  (cost  two  to  one) 


Forecasted 

Observed 

HR 

TS 

POD 

FAR 

Bias 

KSS 

YES 

NO 

YES 

910 

1931 

53% 

0.31 

0.94 

0.68 

2.9 

0.35 

NO 

60 

1379 

Table  A56.  Verification  results  for  Grissom  AFB  25  nm  (cost  two  to  one) 


Forecasted 

Observed 

HR 

TS 

POD 

FAR 

Bias 

KSS 

YES 

NO 

YES 

92 

151 

61% 

0.36 

0.86 

0.62 

2.3 

0.39 

NO 

15 

170 

A8.  McGuire  AFB 


72 


Table  A57.  Model  results  for  McGuire  AFB  10  nm  (cost  one  to  one) 


Forecasted 

Observed 

HR 

TS 

POD 

FAR 

Bias 

KSS 

YES 

NO 

YES 

323 

1421 

64% 

0.17 

0.76 

0.81 

4.1 

0.39 

NO 

102 

2434 

Table  A58.  Verification  results  for  McGuire  AFB  10  nm  (cost  one  to  one) 


Forecasted 

Observed 

HR 

TS 

POD 

FAR 

Bias 

KSS 

YES 

NO 

YES 

38 

145 

64% 

0.20 

0.81 

0.79 

3.9 

0.43 

NO 

9 

236 

Table  A59.  Model  results  for  McGuire  AFB  10  nm  (cost  two  to  one) 


Forecasted 

Observed 

HR 

TS 

POD 

FAR 

Bias 

KSS 

YES 

NO 

YES 

400 

1965 

54% 

0.17 

0.94 

0.83 

5.6 

0.43 

NO 

25 

1890 

Table  A60.  Verification  results  for  McGuire  AFB  10  nm  (cost  two  to  one) 


Forecasted 

Observed 

HR 

TS 

POD 

FAR 

Bias 

KSS 

YES 

NO 

YES 

46 

216 

49% 

0.17 

0.98 

0.82 

5.6 

0.41 

NO 

1 

165 

73 


Table  A61.  Model  results  for  McGuire  AFB  25  nm  (cost  one  to  one) 


Forecasted 

Observed 

HR 

TS 

POD 

FAR 

Bias 

KSS 

YES 

NO 

YES 

606 

1318 

66% 

0.29 

0.82 

0.69 

2.6 

0.44 

NO 

136 

2220 

Table  A62.  Verification  results  for  McGuire  AFB  25  nm  (cost  one  to  one) 


Forecasted 

Observed 

HR 

TS 

POD 

FAR 

Bias 

KSS 

YES 

NO 

YES 

70 

129 

66% 

0.33 

0.81 

0.65 

2.3 

0.44 

NO 

16 

213 

Table  A63.  Model  results  for  McGuire  AFB  25  nm  (cost  two  to  one) 


Forecasted 

Observed 

HR 

TS 

POD 

FAR 

Bias 

KSS 

YES 

NO 

YES 

695 

1769 

58% 

0.28 

0.94 

0.72 

3.3 

0.44 

NO 

47 

1769 

Table  A64.  Verification  results  for  McGuire  AFB  25  nm  (cost  two  to  one) 


Forecasted 

Observed 

HR 

TS 

POD 

FAR 

Bias 

KSS 

YES 

NO 

YES 

84 

181 

57% 

0.31 

0.98 

0.68 

3.1 

0.45 

NO 

2 

161 

74 


A9.  Minot  AFB 


Table  A65.  Model  results  for  Minot  AFB  10  nm  (cost  one  to  one) 


Forecasted 

Observed 

HR 

TS 

POD 

FAR 

Bias 

KSS 

YES 

NO 

YES 

410 

911 

78% 

0.30 

0.94 

0.69 

3.0 

0.70 

NO 

26 

2933 

Table  A66.  Verification  results  for  Minot  AFB  10  nm  (cost  one  to  one) 


Forecasted 

Observed 

HR 

TS 

POD 

FAR 

Bias 

KSS 

YES 

NO 

YES 

20 

91 

76% 

0.16 

0.63 

0.82 

3.5 

0.40 

NO 

12 

305 

Table  A67.  Model  results  for  Minot  AFB  10  nm  (cost  two  to  one) 


Forecasted 

Observed 

HR 

TS 

POD 

FAR 

Bias 

KSS 

YES 

NO 

YES 

418 

1654 

61% 

0.20 

0.96 

0.80 

4.8 

0.53 

NO 

18 

2190 

Table  A68.  Verification  results  for  Minot  AFB  10  nm  (cost  two  to  one) 


Forecasted 

Observed 

HR 

TS 

POD 

FAR 

Bias 

KSS 

YES 

NO 

YES 

27 

161 

61% 

0.14 

0.84 

0.86 

5.9 

0.44 

NO 

5 

235 

75 


Table  A69.  Model  results  for  Minot  AFB  25  nm  (cost  one  to  one) 


Observed 

HD 

DAD 

ITCC 

r  Ui  CCaSlCQ 

YES 

NO 

XlJx 

1  o 

X  ULI 

r  Jx 

DlaS 

YES 

612 

1096 

700/. 

A  0/1 

A  Q/l 

A 

0  A 

A  "sO 

NO 

114 

2458 

/ ^  /o 

U.  OH- 

U.OH- 

U.OH- 

Table  A70.  Verification  results  for  Minot  AFB  25  nm  (cost  one  to  one) 


Observed 

HD 

DC 

DAD 

ircc 

r  Ui  CCaSlCQ 

YES 

NO 

xlJv 

1  o 

X 

r  Jx 

IxlaS 

YES 

45 

118 

A 

A 

A  70 

0  8 

(AAA 

NO 

14 

251 

oy  /o 

U.  /  0 

\). !  jL 

z.o 

Table  A71.  Model  results  for  Minot  AFB  25  nm  (cost  two  to  one) 


Observed 

HD 

DC 

DAD 

ITCC 

r  Ux CCaSlCQ 

YES 

NO 

FlJx 

1  O 

i  ULI 

r  ix  Jx 

DlSiS 

1x00 

YES 

690 

1394 

^70/. 

A  00 

A 

A  ^7 

0  Q 

A 

NO 

36 

2160 

0  /  /o 

u.oo 

Kj.yD 

U.O  / 

L,y 

U.^U 

Table  A72.  Verification  results  for  Minot  AFB  25  nm  (cost  two  to  one) 


Observed 

HD 

DC 

DAD 

ircc 

r  Ox  CCSiSlCQ 

YES 

NO 

DlJx 

1  O 

X  ULI 

r  /\  lx 

DlUS 

Jxoo 

YES 

46 

147 

/;oo/. 

A  00 

A  7Q 

A  7/; 

0  0 

A  OQ 

NO 

13 

222 

UO  /o 

\)  .Z.Z. 

U.  /  O 

U.  /  0 

U.O  O 

76 


AlO.  OffuttAFB 


Table  A73.  Model  results  for  Offutt  AFB  10  nm  (cost  one  to  one) 


Forecasted 

Observed 

HR 

TS 

POD 

FAR 

Bias 

KSS 

YES 

NO 

YES 

499 

1524 

62% 

0.23 

0.81 

0.75 

3.3 

0.40 

NO 

115 

2142 

Table  A74.  Verification  results  for  Offutt  AFB  10  nm  (cost  one  to  one) 


Forecasted 

Observed 

HR 

TS 

POD 

FAR 

Bias 

KSS 

YES 

NO 

YES 

52 

164 

60% 

0.23 

0.87 

0.76 

3.6 

0.42 

NO 

8 

204 

Table  A75.  Model  results  for  Offutt  AFB  10  nm  (cost  two  to  one) 


Forecasted 

Observed 

HR 

TS 

POD 

FAR 

Bias 

KSS 

YES 

NO 

YES 

579 

1807 

57% 

0.24 

0.94 

0.76 

3.9 

0.45 

NO 

35 

1859 

Table  A76.  Verification  results  for  Offutt  AFB  10  nm  (cost  two  to  one) 


Forecasted 

Observed 

HR 

TS 

POD 

FAR 

Bias 

KSS 

YES 

NO 

YES 

55 

191 

54% 

0.22 

0.92 

0.78 

4.1 

0.40 

NO 

5 

177 

77 


Table  All .  Model  results  for  Offutt  AFB  25  nm  (cost  one  to  one) 


Forecasted 

Observed 

HR 

TS 

POD 

FAR 

Bias 

KSS 

YES 

NO 

YES 

884 

1034 

73% 

0.43 

0.86 

0.54 

1.9 

0.55 

NO 

140 

2222 

Table  A78.  Verification  results  for  Offutt  AFB  25  nm  (cost  one  to  one) 


Forecasted 

Observed 

HR 

TS 

POD 

FAR 

Bias 

KSS 

YES 

NO 

YES 

77 

107 

69% 

0.37 

0.76 

0.58 

1.8 

0.44 

NO 

24 

220 

Table  A79.  Model  results  for  Offutt  AFB  25  nm  (cost  two  to  one) 


Forecasted 

Observed 

HR 

TS 

POD 

FAR 

Bias 

KSS 

YES 

NO 

YES 

982 

1380 

67% 

0.41 

0.96 

0.58 

2.3 

0.54 

NO 

42 

1876 

Table  A80.  Verification  results  for  Offutt  AFB  25  nm  (cost  two  to  one) 


Forecasted 

Observed 

HR 

TS 

POD 

FAR 

Bias 

KSS 

YES 

NO 

YES 

87 

150 

62% 

0.35 

0.86 

0.63 

2.3 

0.40 

NO 

14 

177 

78 


All.  Scott AFB 


Table  A81.  Model  results  for  Scott  AFB  10  nm  (cost  one  to  one) 


Observed 

HD 

DAD 

ITCC 

r  or  CCaSlCQ 

YES 

NO 

xlJv 

1  o 

IlKJIJ 

r  Jv 

DlaS 

YES 

527 

1192 

A  OQ 

n  7^ 

A  /;q 

7  A 

A  /I7 

NO 

176 

2385 

Do  /o 

U.ZO 

\). !  J 

u.oy 

Table  A82.  Verification  results  for  Scott  AFB  10  nm  (cost  one  to  one) 


Observed 

HD 

DC 

DAD 

IZCC 

r  or  CCSiSlCQ 

YES 

NO 

XlJx 

1  O 

X  ULI 

r  /\  Jx 

IxlaS 

YES 

51 

132 

A  7/; 

A  7Q 

A  77 

7  8 

A  /I7 

NO 

14 

231 

DO  /o 

U.ZO 

U.  /  O 

u.  /z 

Z.O 

Table  A83.  Model  results  for  Scott  AFB  10  nm  (cost  two  to  one) 


Observed 

HD 

DC 

DAD 

IZCC 

r  OiCCaSlCQ 

YES 

NO 

xlJx 

1  O 

X 

r  /\  Jx 

IxlUS 

Jxoo 

YES 

677 

1757 

A  7Q 

A 

A  77 

A  /I7 

NO 

26 

1820 

7 o  /o 

U.ZO 

u.yo 

u.  /z 

7.7 

U.H-  / 

Table  A84.  Verification  results  for  Scott  AFB  10  nm  (cost  two  to  one) 


Observed 

HD 

DC 

DAD 

IZCC 

r  UxCCSiSlCQ 

YES 

NO 

xiJx 

1  O 

i  VJH 

r  ix  Jx 

IxlSiS 

YES 

57 

184 

^^0/. 

A  77 

A 

A  7/; 

7  7 

A  77 

NO 

8 

179 

77  /o 

U.Z7 

U.oo 

U.  / 0 

7 .  / 

U.7  / 

79 


Table  A85.  Model  results  for  Scott  AFB  25  nm  (cost  one  to  one) 


Observed 

HD 

DAD 

ircc 

r  Ui  CCaSlCQ 

YES 

NO 

xlJx 

1  O 

X  ULI 

r  Jx 

DlaS 

YES 

954 

1072 

700/. 

A  /I/I 

A  QQ 

A  "sO 

1  Q 

A 

NO 

136 

2118 

!  A.  /a 

U.OO 

1  ,y 

U.OH- 

Table  A86.  Verification  results  for  Scott  AFB  25  nm  (cost  one  to  one) 


Observed 

HD 

DC 

DAD 

ircc 

r  Ui  CCaSlCQ 

YES 

NO 

xlJv 

1  o 

X 

r  Jv 

IxlaS 

YES 

73 

117 

A  0/1 

A  70 

A  /;o 

1  Q 

A  07 

NO 

27 

211 

00  /o 

U.OH- 

U.  /  0 

u.oz 

1  .y 

U.J>  / 

Table  A87.  Model  results  for  Scott  AFB  25  nm  (cost  two  to  one) 


Observed 

HD 

DC 

DAD 

ircc 

r  or  cCaSlCQ 

YES 

NO 

xiJv 

1  o 

i  ULI 

r  Jv 

ixlSiS 

YES 

1061 

1314 

/;qo/. 

A  /I/I 

A  Q7 

A  's's 

0  0 

NO 

29 

1876 

oy  /o 

\j,y  / 

z.,z. 

U.OO 

Table  A88.  Verification  results  for  Scott  AFB  25  nm  (cost  two  to  one) 


Observed 

HD 

DC 

DAD 

ircc 

r  Ox  CCaSlCQ 

YES 

NO 

JTlJx 

1  O 

X 

r  /\  Jx 

DlaS 

Jxoo 

YES 

84 

150 

o/„ 

A  0/1 

A  Q/l 

A  ^/l 

0  0 

A  OQ 

NO 

16 

178 

01  /o 

U.OH- 

U.OH- 

U.OH- 

U.O  O 

A 12.  WestoverAFB 
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Table  A89.  Model  results  for  Westover  AFB  10  nm  (cost  one  to  one) 


Forecasted 

Observed 

HR 

TS 

POD 

FAR 

Bias 

KSS 

YES 

NO 

YES 

302 

1275 

69% 

0.19 

0.89 

0.81 

4.7 

0.57 

NO 

37 

2666 

Table  A90.  Verification  results  for  Westover  AFB  10  nm  (cost  one  to  one) 


Forecasted 

Observed 

HR 

TS 

POD 

FAR 

Bias 

KSS 

YES 

NO 

YES 

23 

143 

66% 

0.14 

0.88 

0.86 

6.4 

0.53 

NO 

3 

259 

Table  A91 .  Model  results  for  Westover  AFB  10  nm  (cost  two  to  one) 


Forecasted 

Observed 

HR 

TS 

POD 

FAR 

Bias 

KSS 

YES 

NO 

YES 

334 

1284 

70% 

0.21 

0.99 

0.79 

4.8 

0.66 

NO 

5 

2657 

Table  A92.  Verification  results  for  Westover  AFB  10  nm  (cost  two  to  one) 


Forecasted 

Observed 

HR 

TS 

POD 

FAR 

Bias 

KSS 

YES 

NO 

YES 

22 

149 

64% 

0.13 

0.85 

0.87 

6.6 

0.48 

NO 

4 

253 

81 


Table  A93.  Model  results  for  Westover  AFB  25  nm  (cost  one  to  one) 


Forecasted 

Observed 

HR 

TS 

POD 

FAR 

Bias 

KSS 

YES 

NO 

YES 

525 

1052 

74% 

0.32 

0.87 

0.67 

2.6 

0.59 

NO 

77 

2626 

Table  A94.  Verification  results  for  Westover  AFB  25  nm  (cost  one  to  one) 


Forecasted 

Observed 

HR 

TS 

POD 

FAR 

Bias 

KSS 

YES 

NO 

YES 

47 

125 

70% 

0.27 

0.92 

0.73 

3.4 

0.59 

NO 

4 

252 

Table  A95.  Model  results  for  Westover  AFB  25  nm  (cost  two  to  one) 


Forecasted 

Observed 

HR 

TS 

POD 

FAR 

Bias 

KSS 

YES 

NO 

YES 

567 

1248 

70% 

0.31 

0.94 

0.69 

3.0 

0.60 

NO 

35 

2430 

Table  A96.  Verification  results  for  Westover  AFB  25  nm  (cost  two  to  one) 


Forecasted 

Observed 

HR 

TS 

POD 

FAR 

Bias 

KSS 

YES 

NO 

YES 

47 

148 

64% 

0.24 

0.92 

0.76 

3.8 

0.53 

NO 

4 

229 

A 1 3 .  Wright  Patterson  AFB 
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Table  A97.  ^ 

lodel  results  for  Wright  Patterson  AFB  1 0  nm 

^cost  one  to  one) 

Observed 

HD 

DAD 

ircc 

r  or CCSiSlCQ 

YES 

NO 

1  o 

SlKJIJ 

r  Jv 

DlaS 

YES 

589 

1211 

A  ^  1 

A 

A 

A  "si 

NO 

107 

2373 

vy  /o 

U.J>  1 

\).OD 

U.O  / 

z.o 

KJ.D  1 

Table  A98.  Verification  results  for  Wright  Patterson  AFB  10  nm  (cost  one  to  one) 


Observed 

HD 

DC 

DAD 

ITCC 

r  Ui  CCaSlCQ 

YES 

NO 

xlJx 

1  o 

X 

r  Jv 

DlaS 

YES 

75 

113 

7A0/. 

A  97 

A  QA 

A 

9  1 

A  "si 

NO 

14 

226 

/  U  /o 

U.J>  / 

U.OH- 

u.ou 

Z..  1 

U.9  1 

Table  A99. 

Model  results  for  Wright  Patterson  AFB  1 0  nm  i 

cost  two  to  one) 

Observed 

HD 

DC 

DAD 

ITCC 

r  or CCaSlCQ 

YES 

NO 

xlJx 

1  O 

±yJL9 

r  /\  Jx 

IxlSiS 

YES 

657 

1754 

A  97 

A  Q/l 

A  79 

9  "s 

A  /I  ^ 

NO 

39 

1830 

9 o  /o 

u.z  / 

u.yH- 

U.  /  9 

9.9 

U.‘H-9 

Table  AlOO.  Verification  results  for  Wright  Patterson  AFB  10  nm  (cost  two  to  one) 


Observed 

HD 

DC 

DAD 

ircc 

r  OiCCaSlCQ 

YES 

NO 

xlJx 

1  o 

±yJL9 

r  /\  Jx 

DlSiS 

Jxoo 

YES 

85 

164 

0/. 

A  9/1 

A 

9  8 

A  /I7 

NO 

4 

175 

01  /o 

U.9‘H- 

u.yo 

U.OO 

z.o 

U.H-  / 
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Table  AlOl.  Model  results  for  Wright  Patterson  AFB  25  nm  (cost  one  to  one) 


Observed 

HD 

DAD 

ITCC 

r  Ui  CCaSlCQ 

YES 

NO 

xlJx 

1  o 

r  Jx 

DlaS 

YES 

844 

873 

7/10/. 

A  /I7 

n  7Q 

n  "si 

1  ^ 

n 

NO 

224 

2339 

/H-  /O 

\j,  /y 

\J,D  1 

1 .0 

Table  A102.  Verification  results  for  Wright  Patterson  AFB  25  nm  (cost  one  to  one) 


Observed 

HD 

DC 

DAD 

ITCC 

r  Ui  CCaSlcQ 

YES 

NO 

xlJv 

1  o 

±\JL9 

r  Jx 

DlaS 

YES 

107 

107 

770/. 

A  /!/; 

A  QA 

A  ^A 

1  7 

A  "si 

NO 

21 

224 

II  /O 

U.H-O 

U.OH- 

KJ.DKJ 

1 .  / 

KJ.D  1 

Table  A103.  Model  results  for  Wright  Patterson  AFB  25  nm  (cost  two  to  one) 


Observed 

HD 

DC 

DAD 

ITCC 

r  Ui  CCaSlCQ 

YES 

NO 

FlJx 

1  O 

±%JL9 

r  ix  Jx 

DlSiS 

1x00 

YES 

1009 

1558 

^70/. 

A  7Q 

A  Q/l 

A  ^1 

7  A 

A  /l^ 

NO 

59 

1654 

/o 

U.  O 

u.yH- 

U.0 1 

U.H-O 

Table  A104.  Verification  results  for  Wright  Patterson  AFB  25  nm  (cost  two  to  one) 


Observed 

HD 

DC 

DAD 

ITCC 

r  or  CCSiSlCQ 

YES 

NO 

xlJx 

1  O 

±vJL9 

r  /\  lx 

DlaS 

Jxoo 

YES 

124 

143 

A  A^ 

A  07 

A  ^A 

7  1 

A  /IQ 

NO 

4 

157 

00  /o 

U.H-O 

Kj.y  / 

U.7H- 

Z.  1 

U.'H-y 
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Appendix  B:  Forecast  Rules 


This  appendix  presents  the  eomplete  list  of  foreeast  rules  for  the  13  loeations  in 
the  15*’^  OWS  AOR.  The  tables  were  eomposed  from  the  positive  CG  lightning  results 
found  using  the  CART  analysis.  The  positive  terminal  nodes  for  the  learning  tree  were 
required  to  have  at  least  a  1%  total  probability  to  be  ineluded  in  the  set  of  rules.  All 
terminals  nodes  not  meeting  this  requirement  were  eliminated.  These  foreeast  rules  were 
ereated  using  data  from  a  speeifie  upper  air  station  (see  table  12  for  the  eorreet  station). 
The  learning  data  is  from  1993  to  2002  and  was  used  to  build  the  models.  Independent 
test  data  from  2003  was  used  to  validate  the  models. 

The  eost  matrix  used  to  ereate  eaeh  deeision  tree  was  based  on  the  importance  of 
correctly  forecasting  CG  lightning.  A  one  to  one  cost  weighed  the  importance  of 
correctly  forecasting  CG  lightning  and  false  alarm  rates  equally.  A  tree  built  using  a  two 
to  one  cost  matrix  expressed  the  importance  of  correctly  forecasting  CG  lightning.  These 
trees  simply  implied  that  it  was  twice  as  important  to  not  miss  a  CG  lightning  occurrence 
as  it  was  to  forecast  for  CG  lightning  and  it  not  occur. 

Four  tables  are  provided  for  each  location:  1)  a  10  nm  radius  with  a  one  to  one 
cost,  2)  a  10  nm  radius  with  a  two  to  one  cost,  3)  a  25  nm  radius  with  a  one  to  one  cost, 
and  4)  a  25  nm  radius  with  a  two  to  one  cost.  Each  table  contains  forecast  rules,  and  the 
probabilities  of  forecasting  CG  lightning  correctly.  This  probability  is  calculated  using 
Bayes  Rules  (see  chapter  4). 
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Tables  B-1  through  B-4  are  the  foreeast  rules  and  probabilities  for  Andrews  Air 
Foree  Base,  Maryland.  Washington/  Dules,  VA  (724030)  was  the  upper  air  site  matehed 
with  Andrews.  The  following  eombination  of  CG  lightning  predietors  were  determined 
to  produee  the  best  sueeess  rate  for  Andrews:  1)  Showalters  Stability  Index  (SSI),  2)  K 
Index  (KI),  3)  Severe  Weather  Threat  Index  (SWEAT),  4)  Lifted  Index  (LI),  and  5) 
Surfaee  pressure  at  Andrews  (STAPRESS). 


Table  B-1.  Rules  to  predict  CG  lightning  for  Andrews  AFB  within  10  nm  (cost  one 
to  one) 


Rules  to  Forecast  CG  lightning 

Probability  of 
correctly  predicting 
CG  lightning 

IF  SSI  <=  0.04 

0.79 

IF  SSI  >0.04  AND  SSI  <=  3.66  AND  KI<=  28.95 
AND  SWEAT  >206.5 

0.62 

IF  SSI  >0.04  AND  SSI  <=3.66  AND  KI>  28.95 

0.61 

Table  B-2. 
to  one) 

Rules  to  predict  CG  lightning  for  Andrews  AFB  within  10  nm  (cost  two 

Rules  to  Forecast  CG  lightning 

Probability  of 
correctly  predicting 
CG  lightning 

IF  SSI  <=3.66 

0.65 

86 


Table  B-3.  Rules  to  predict  CG  lightning  for  Andrews  AFB  within  25  nm  (cost  one 
to  one) 


Rules  to  Forecast  CG  lightning 

Probability  of 
correctly  predicting 
CG  lightning 

IF  SSI  <=3.76  AND  KI<=  28.85  AND 
STAPRESS<=  1010.2  AND  LI  <=-0.85 

0.69 

IF  SSI  <=3.76  AND  KI<=  28.85  AND  LI  >-0.85 
AND  STAPRESS  <=  998.0 

0.76 

IF  SSI  <=  3.76  AND  STAPRESS  >  998.0  AND 
STAPRESS  <=  1010.2  AND  KI>  23.45  AND 

KI<=  28.85  AND  LI  >-0.85  AND  LI  <=  3.95 

0.62 

IF  SSI  <=3.76  AND  KI>  28.85  AND  LI  <=  0.25 

0.76 

IF  SSI  <=3.76  AND  KI>  28.85  AND  LI  >  0.25  AND 
STAPRESS  <=  1008.4 

0.71 

Table  B-4.  Rules  to  predict  CG  lightning  for  Andrews  AFB  within  25  nm  (cost  two 
to  one) 

Rules  to  Forecast  CG  lightning 

Probability  of 
correctly  predicting 
CG  lightning 

IF  SSI  <=  3.76 

0.66 

IF  SSI  >3.76  AND  STAPRESS  <=  1007.72  AND 

KI>  12.85  AND  LI  <=4.35 

0.54 

Tables  B-5  through  B-8  are  the  foreeast  rules  and  probabilities  for  Dover  Air 
Foree  Base,  Delaware.  Washington/  Dules,  VA  (724030)  was  the  upper  air  site  matehed 
with  Dover.  The  following  eombination  of  CG  lightning  predietors  were  determined  to 
produee  the  best  sueeess  rate  for  Dover:  1)  Showalters  Stability  Index  (SSI),  2) 
Conveetive  Available  Potential  Energy  (CAPE),  and  3)  Total  Totals  Index  (TTI). 
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Table  B-5.  Rules  to  predict  CG  lightning  for  Dover  AFB  within  10  nm  (cost  one  to 
one). 


Rules  to  Forecast  CG  lightning 

Probability  of 
correctly  predicting 
CG  lightning 

IF  SSI  <=3.74  AND  CAPE  >177.1 

0.71 

Table  B-6. 
one). 

Rules  to  predict  CG  lightning  for  Dover  AFB  within  1 0  nm  (cost  two  to 

Rules  to  Forecast  CG  lightning 

Probability  of 
correctly  predicting 
CG  lightning 

IF  SSI  <=3.74 

0.66 

Table  B-7.  Rules  to  predict  CG  lightning  for  Dover  AFB  within  25  nm  (cost  one  to 
one). 

Rules  to  Forecast  CG  lightning 

Probability  of 
correctly  predicting 
CG  lightning 

IF  SSI<=  1.46 

0.72 

IF  SSI  >1.46  AND  SSI  <=3.52  AND  CAPE  <=  303.3 
AND  TTI>  47.05 

0.62 

IF  SSI  >1.46  AND  SSI  <=  3.52  AND  TTI  >  40.55 
AND  CAPE  >303.3 

0.68 

Table  B-8.  Rules  to  predict  CG  lightning  for  Dover  AFB  within  25  nm  (cost  two  to 
one). 


Rules  to  Forecast  CG  lightning 

Probability  of 
correctly  predicting 
CG  lightning 

IF  SSI  <=3.74 

0.67 

Tables  B-9  through  B-12  are  the  foreeast  rules  and  probabilities  for  Ellsworth  Air 
Foree  Base,  South  Dakota.  Rapid  City  Regional  Airport  (726620)  was  the  upper  air  site 
matehed  with  Ellsworth  AFB.  The  following  eombination  of  CG  lightning  predietors 
were  determined  to  produee  the  best  sueeess  rate  for  Ellsworth:  1)  Eifted  Index  (El),  2) 
Showalters  Stability  Index  (SSI),  3)  Total  Totals  Index  (TTI)  4)  K  Index  (KI),  5)  Month, 
6)  KO  Index  (KO),  7)  Severe  Weather  Threat  Index  (SWEAT),  8)  Surfaee  pressure  at 
Ellsworth  (STAPRESS),  9)  Surfaee  pressure  at  Rapid  City  Regional  Airport 
(PRESS  UA),  and  10)  Three  hour  surfaee  pressure  ehange  at  Ellsworth  matehing  the 
sounding  time  (PRESC3). 


Table  B-9.  Rules  to  predict  CG  lightning  for  Ellsworth  AFB  within  10  nm  (cost  one 
to  one). 

Probability  of 

Rules  to  Forecast  CG  lightning  correctly  predicting 

_ CG  lightning 

IF  LI  <=2.65  AND  SSI  <=-1.19  0.85 


IF  LI  <=2.65  AND  SSI  >-1.19  AND  TTI  <=53.5 
AND  KI>  25.05 


0.62 
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Table  B-10.  Rules  to  predict  CG  lightning  for  Ellsworth  AFB  within  10  nm  (cost 
two  to  one). 


Rules  to  Forecast  CG  lightning 

Probability  of 
correctly  predicting 
CG  lightning 

IF  FI  <=-0.45 

0.75 

IF  MONTH  =  3  OR  4  AND  FI  >  -0.45  AND 

FI  <=3.65  AND  KO>1.3  AND  SWEAT  <=113.5 

0.58 

IF  MONTH  =  5,  6,  7,  8,  OR  9  AND  FI  >  -0.45  AND 

FI  <=2.65  AND  STAPRESS  >  889.7  AND 
STAPRESS  <=  909.7  AND  KO  > -7.95  AND 

KO  <=  0.55 

0.58 

IF  MONTH  =  5,  6,  7,  8,  OR  9  AND  FI  >  -0.45  AND 

FI  <=3.65  AND  KO  >  0.55  AND 

PRESS_UA  <=  907.5 

0.71 

IF  MONTH  =  3,  4,  5,  OR  9  AND  FI  >  3.65  AND 
SWEAT  >  142  AND  KI  >  16.2 

0.55 

IF  MONTH  =  6,  7,  or  8  AND  FI  >  3.65  AND 

SSI  <=6.38  AND  KO  <=  6.65  AND  TTI<=41.5 
AND  PRESS  UA<=  903.5  AND  PRESC3>-1.1 

0.54 

Table  B-11. 
one  to  one). 

Rules  to  predict  CG  lightning  for  Ellsworth  AFB  within  25  nm  (cost 

Rules  to  Forecast  CG  lightning 

Probability  of 
correctly  predicting 
CG  lightning 

IF  SSI  <=-1.17 

0.83 

IF  MONTH  =  5,  6,  7,  8,  OR  9  AND  SSI  >-1.17  AND 
SSI  <=2.90 

0.64 
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Table  B-12.  Rules  to  predict  CG  lightning  for  Ellsworth  AFB  within  25  nm  (cost 
two  to  one). 


Rules  to  Forecast  CG  lightning 

Probability  of 
correctly  predicting 
CG  lightning 

IF  MONTH  =  5,  6,  7,  8,  OR  9  AND  SSI  <=  3.00  AND 

FI  <=  0.25 

0.76 

IF  MONTH  =  5,  6,  7,  8,  OR  9  AND  SSI  <=  3.00  AND 

FI  >0.25  AND  KO>-6.35 

0.64 

IF  MONTH  =  8  AND  SSI  >  3.00  AND  SSI  <=  6.93 
AND  KI<=  23.95  AND  KO<=4.25 

0.44 

IF  SSI  >3.00  AND  SSI  <=  6.93  AND  KI<=  23.95 
AND  KO>4.25  AND  CAPE  >  7.4 

0.57 

IF  MONTH  =  6  or  7  AND  SSI  >3.00  AND 

SSI  <=6.93  AND  KI>  23.95  AND  KO  <=  6.65 

0.54 

IF  SSI  >3.00  AND  SSI  <=  6.93  AND  KI>  23.95 
AND  KO>6.65 

0.72 

Tables  B-13  through  B-16  are  the  foreeast  rules  and  probabilities  for  Fort  Belvoir, 
Virginia.  Washington/Dulles  (724030)  was  the  upper  air  site  matehed  with  Ft  Belvoir. 
The  following  CG  lightning  predietors  were  determined  to  produee  the  best  sueeess  rate 
for  Ft  Belvoir:  1)  Lifted  Index  (LI),  2)  Showalters  Stability  Index  (SSI),  3)  K  Index  (KI), 
5)  Severe  Weather  Threat  Index  (SWEAT),  and  8)  Conveetive  Available  Potential 
Energy  (CAPE). 
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Table  B-13.  Rules  to  predict  CG  lightning  for  Ft  Belvoir  within  10  nm  (cost  one  to 
one). 


Rules  to  Forecast  CG  lightning 

Probability  of 
correctly  predicting 

CG  lightning 

IF 

KI<=  26.65  AND  SSI  <=1.03  AND  El  <= -0.95 

0.65 

IF 

KI<=  26.65  AND  SSI  >1.03  AND  SSI  <=1.28 

0.78 

SSI  <=1.28  AND  KI>  26.65 

0.72 

IF  SSI  >1.28  AND  SSI  <=3.61  AND 

0.75 

SWEAT  >132.5  AND  CAPE  >132.9  AND  KI<=16.6 

IF  SSI  >1.28  AND  SSI  <=3.61  AND 

0.57 

SWEAT  >132.5  AND  KI>  24.25 

Table  B-14.  Rules  to  predict  CG  lightning  for  Ft  Belvoir  within  10  nm  (cost  two  to 
one). 

Rules  to  Forecast  CG  lightning 

Probability  of 
correctly  predicting 
CG  lightning 

IF  SSI  <=3.61 

0.65 

92 


Table  B-15.  Rules  to  predict  CG  lightning  for  Ft  Belvoir  within  25  nm  (cost  one  to 
one). 


Rules  to  Forecast  CG  lightning 

Probability  of 
correctly  predicting 
CG  lightning 

IF 

SSI  <=3.74  AND  KI<=  28.85  AND  CAPE  >  82.8 
AND  SWEAT  <=207.5  AND  LI  <=-1.25 

0.63 

IF  SSI  <=3.74  AND  KI<=  28.85  AND 

SWEAT  <=207.5  AND  LI  >-1.25  AND 

CAPE  >82.8  AND  CAPE  <=209.5 

0.64 

IF 

SSI  <=3.74  AND  KI<=  28.85  AND  CAPE  >  82.8 
AND  SWEAT  >207.5 

0.68 

IF  SSI  <=3.74  AND  KI>  28.85 

0.73 

Table  B-16.  Rules  to  predict  CG  lightning  for  Ft  Belvoir  within  25  nm  (cost  two  to 
one). 

Rules  to  Forecast  CG  lightning 

Probability  of 
correctly  predicting 
CG  lightning 

IF  SSI  <=3.74 

0.67 

Tables  B-17  through  B-20  are  the  foreeast  rules  and  probabilities  for  Fort  Drum, 
New  York.  Buffalo  International  Airport  (725280)  was  the  upper  air  site  matehed  with  Ft 
Drum.  The  following  CG  lightning  predietors  were  determined  to  produee  the  best 
sueeess  rate  for  Ft  Drum:  1)  Lifted  Index  (LI),  2)  Showalters  Stability  Index  (SSI),  3) 
Total  Totals  Index  (TTI)  4)  K  Index  (KI),  5)  Conveetive  Available  Potential  Energy 
(CAPE),  6)  KO  Index  (KO),  7)  Severe  Weather  Threat  Index  (SWEAT),  and  8) 
Temperature  in  Celsius  for  Et  Drum  at  sounding  time  (TEMPC). 
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Table  B-17.  Rules  to  predict  CG  lightning  for  Ft  Drum  within  10  nm  (cost  one  to 
one). 


Rules  to  Forecast  CG  lightning 

Probability  of 
correctly  predicting 
CG  lightning 

IF  CAPE  <=160.6  AND  KI>  24.15  AND 
SWEAT  >  192.5  AND  TEMPC  <=  16.6 

0.65 

IF  CAPE  >160.6 

0.78 

Table  B-18.  Rules  to  predict  CG  lightning  for  Ft  Drum  within  10  nm  (cost  two  to 
one). 

Rules  to  Forecast  CG  lightning 

Probability  of 
correctly  predicting 
CG  lightning 

IF  CAPE  <=160.6  AND  KI>  24.45  AND 

SWEAT  <=192.5  AND  SSI  >1.74  AND 

SSI  <=4.77  AND  TTI>43.1 

0.57 

IF  SSI  <=4.77  AND  CAPE  <=160.6 

AND  KI>  24.45  AND  SWEAT  >  192.5 

0.68 

IF  SSI  <=4.77  AND  CAPE  >160.6 

0.75 

IF  SWEAT  >  66.5  AND  SSI  >  8.60  AND 

El  <=  6.95 

0.73 

IF  SSI  >8.60  AND  El  >  6.95  AND  El  <=10.45  AND 
SWEAT  >105.5 

0.45 
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Table  B-19.  Rules  to  predict  CG  lightning  for  Ft  Drum  within  25  nm  (cost  one  to 
one). 


Rules  to  Forecast  CG  lightning 

Probability  of 
correctly  predicting 
CG  lightning 

IF  LI  <=2.35  AND  CAPE  >183.6  AND  KI  >  12.4 

0.83 

IF  LI  >2.35  AND  LI  <=6.95  AND  KI>  21.05 

AND  SWEAT  >185.5  AND  SWEAT  <=214.5 

0.75 

IF  LI  >2.35  AND  LI  <=  6.95  AND  SWEAT  >214.5 
AND  SSI  >2.31  AND  KI>  21.05  AND  KI  <=  30.85 
AND  TTI>38.7 

0.69 

IF  LI  >  2.35  AND  LI  >  6.95  AND  SWEAT  <=  123.5 
AND  MONTH  =  5,  6,  7,  8,  OR  9  AND  SWEAT  >  63.5 
AND  SSI  <=10.40  AND  TTI<=  41.15  AND 
SWEAT  >72.5  AND  TTI  <=  36.95  AND 

SWEAT  >  98 

0.64 

Table  B-20.  Rules  to  predict  CG  lightning  for  Ft  Dmm  within  25  nm  (cost  two  to 
one). 

Rules  to  Forecast  CG  lightning 

Probability  of 
correctly  predicting 
CG  lightning 

IF  LI  <=6.05  AND  CAPE  <=138.1  AND  KI>-3.6 
AND  KI<=  27.05  AND  KO>-5.75  AND  KO  <=  3.65 

0.39 

IF  LI  <=6.05  AND  CAPE  <=138.1  AND  KO>-5.75 
AND  KI>  27.05 

0.59 

IF  LI  <=6.05  AND  CAPE  >138.1 

0.75 

Tables  B-21  through  B-24  are  the  foreeast  rules  and  probabilities  for  Grand  Forks 
Air  Foree  Base,  North  Dakota.  Bismarek  Munieipal  Airport  (7276840)  was  the  upper  air 
site  matehed  with  Grand  Forks.  The  following  CG  lightning  predietors  were  determined 
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to  produce  the  best  sueeess  rate  for  grand  Forks:  1)  Lifted  Index  (LI),  2)  Showalters 
Stability  Index  (SSI),  3)  Total  Totals  Index  (TTI),  4)  K  Index  (KI),  5)  Month,  6) 
Conveetive  Available  Potential  Energy  (CAPE),  and  7)  Severe  Weather  Threat  Index 
(SWEAT). 


Table  B-2L  Rules  to  predict  CG  lightning  for  Grand  Forks  within  10  nm  (cost  one 
to  one). 


Rules  to  Forecast  CG  lightning 

Probability  of 
correctly  predicting 
CG  lightning 

IF  MONTH  =  5,  6,  7,  8,  OR  9  AND  SSI  <=  2.66 

0.75 

IF  MONTH  =  4,  6,  7,  OR  8  AND  SSI  >  2.66  AND 

SSI  <=5.90  AND  KI>  17 

0.60 

IF  SSI  >2.66  AND  SSI  <=5.90  AND  CAPE  >  728.9 

0.84 

Table  B-22.  Rules  to  predict  CG  lightning  for  Grand  Forks  within  10  nm  (cost  two 
to  one). 

Rules  to  Forecast  CG  lightning 

Probability  of 
correctly  predicting 
CG  lightning 

IF  SSI  <=2.27 

0.73 

IF  SSI  >2.27  AND  SSI  <=4.58  AND  CAPE  <=10.5 
AND  LI  <=5.45 

0.53 

IF  CAPE  >10.5  AND  CAPE  <=715.7  AND 

TTI  <=45.7  AND  SSI  >2.27  AND  SSI  <=2.89 

0.60 

IF  SSI  >2.27  AND  SSI  <=4.58  AND  CAPE  >715.7 

0.83 
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Table  B-23.  Rules  to  predict  CG  lightning  for  Grand  Forks  within  25  nm  (cost  one 
to  one). 


Rules  to  Forecast  CG  lightning 

Probability  of 
correctly  predicting 
CG  lightning 

IF  LI  <=4.75  AND  SSI  <=1.32 

0.77 

IF  SSI  >1.32  AND  KI<=  25.25  AND 

CAPE  <=65.9  AND  LI  <=3.05 

0.63 

IF  LI  <=4.75  AND  SSI  >1.32  AND  KI>  25.25 

0.64 

Table  B-24.  Rules  to  predict  CG  lightning  for  Grand  Forks  within  25  nm  (cost  two 
to  one). 

Rules  to  Forecast  CG  lightning 

Probability  of 
correctly  predicting 
CG  lightning 

IF  LI  <=4.75 

0.69 

IF  LI  >  4.75  AND  KI  >  14.65  AND  SWEAT  >  80.5 

0.36 

Tables  B-25  through  B-28  are  the  foreeast  rules  and  probabilities  for  Grissom  Air 
Foree  Base,  Indiana.  Davenport  Upper  Air  (744550)  was  the  upper  air  site  matehed  with 
Grissom.  The  following  CG  lightning  predietors  were  determined  to  produee  the  best 
sueeess  rate  for  Grissom;  1)  Showalters  Stability  Index  (SSI),  3)  Total  Totals  Index  (TTI) 
4)  K  Index  (KI),  5)  Month,  7)  Severe  Weather  Threat  Index  (SWEAT),  8)  Surfaee 
pressure  at  Davenport  (PRESS_UA),  and  10)  Temperature  in  Celsius  for  Grissom  at 
sounding  time  (TEMPC). 
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Table  B-25.  Rules  to  predict  CG  lightning  for  Grissom  within  10  nm  (cost  one  to 
one). 


Rules  to  Forecast  CG  lightning 

Probability  of 
correctly  predicting 
CG  lightning 

IF  MONTH  =  4,  5,  6,  7,  8,  OR  9  AND  SSI  <=  3.93 
AND  TEMPC>1.4  AND  KI>  19.85  &  KI<=  30.15 

0.54 

IF  SSI  <=3.93125  AND  KI>  30.15 

0.75 

Table  B-26.  Rules  to  predict  CG  lightning  for  Grissom  within  10  nm  (cost  two  to 
one). 

Rules  to  Forecast  CG  lightning 

Probability  of 
correctly  predicting 
CG  lightning 

IF  MONTH  =  4,  5,  7,  8,  OR  9  AND  SSI  <=  3.93  AND 
TEMPO  0.3  AND  KI<=  19.85  AND  TTI>43.0 

0.54 

IF  MONTH  =  4,  5,  6,  7,  8,  OR  9  AND  SSI  <=  3.93 
AND  TEMPC>0.3  AND 

KI>  19.85  AND  KI<=  30.15 

0.53 

IF  SSI  <=3.93  AND  KI>  30.15 

0.75 

IF  MONTH  =  3,  7,  8,  OR  9  AND  SSI  >3.93125  AND 
KI>0  AND  TEMPO  25.3 

0.48 

IF  MONTH  =  4,  5,  OR  6  AND  KI  >  0  AND 

PRESS  UA<=  987.1  AND  SSI  >3.93  AND  SSI<= 

6.75 

0.62 

IF  MONTH  =  4,  5,  OR  6  AND  PRESS  UA<=  987.1 
AND  SSI  >6.75  AND  KI>11.8 

0.50 

IF  MONTH  =  4,  5,  OR  6  AND  SSI  >  3.93  AND  KI  >  0 
AND  PRESS  UA>  987.1  AND  TEMPC<=19.5  AND 
SWEAT  >124.5 

0.55 
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Table  B-27.  Rules  to  predict  CG  lightning  for  Grissom  within  25  nm  (cost  one  to 
one). 


Rules  to  Forecast  CG  lightning 

Probability  of 
correctly  predicting 
CG  lightning 

IF  KI<=  23.95  AND  SSI  <=  0.33 

0.70 

IF  SSI  <=3.98  AND  KI>  23.95 

0.65 

IF  SSI  >  3.98  AND  KI  >  16.65  AND  SWEAT  >  145.5 

0.65 

Table  B-28.  Rules  to  predict  CG  lightning  for  Grissom  within  25  nm  (cost  two  to 
one). 

Rules  to  Forecast  CG  lightning 

Probability  of 
correctly  predicting 
CG  lightning 

IF  SSI  <=4.65 

0.62 

IF  SWEAT  >58.5  AND  SWEAT  <=117.5  AND 

KI>  21.15  AND  SSI  >5.55 

0.63 

IF  SSI  >4.65  AND  KI>L85  AND  SWEAT  >145.5 

0.49 

Tables  B-29  through  B-32  are  the  forecast  rules  and  probabilities  for  McGuire  Air 
Force  Base,  New  Jersey.  Pittsburgh  (725200)  was  the  upper  air  site  matched  with 
McGuire.  The  following  CG  lightning  predictors  were  determined  to  produce  the  best 
success  rate  for  McGuire:  1)  Lifted  Index  (LI),  2)  Showalters  Stability  Index  (SSI),  3) 

KO  Index  (KO),  4)  K  Index  (KI),  6)  Convective  Available  Potential  Energy  (CAPE),  and 
7)  Severe  Weather  Threat  Index  (SWEAT). 
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Table  B-29.  Rules  to  predict  CG  lightning  for  McGuire  within  10  nm  (cost  one  to 
one). 


Rules  to  Forecast  CG  lightning 

Probability  of 
correctly  predicting 
CG  lightning 

IF  CAPE  >94.0 

0.67 

Table  B-30.  Rules  to  predict  CG  lightning  for  McGuire  within  10  nm  (cost  two  to 
one). 

Rules  to  Forecast  CG  lightning 

Probability  of 
correctly  predicting 
CG  lightning 

IF  CAPE  <=  33.4  AND  KI  >  23.45  AND  SSI  >  2.03 

0.53 

IF  CAPE  >33.4  AND  KO<=4.75 

0.65 

Table  B-31.  Rules  to  predict  CG  lightning  for  McGuire  within  25  nm  (cost  one  to 
one). 

Rules  to  Forecast  CG  lightning 

Probability  of 
correctly  predicting 
CG  lightning 

IF  CAPE  <=46.5  AND  SSI  >1.95  AND  KI>  21.55 
AND  KI<=  26.75  AND  KO>10.1 

0.64 

IF  CAPE  <=46.5  AND  KO  > -8.45  AND  SSI  >1.95 
AND  KI>  26.75 

0.61 

IF  KI<=  21.75  AND  KO> -13.85  AND  KO  <= -2.65 
AND  CAPE  >183.0 

0.61 

IF  CAPE  >46.5  AND  KI>  21.75  AND  KO<=4.75 

0.70 
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Table  B-32.  Rules  to  predict  CG  lightning  for  McGuire  within  25  nm  (cost  two  to 
one). 


Rules  to  Forecast  CG  lightning 

Probability  of 
correctly  predicting 
CG  lightning 

IF  SSI  <=5.21  AND  CAPE  <=38.8  AND 

SWEAT  <=  152.5  AND  KI  >  19.4 

0.43 

IF  SSI  <=5.21  AND  CAPE  <=38.8  AND 

SWEAT  >152.5  AND  SWEAT  <=288.5 

0.55 

IF  SSI  <=5.21  AND  CAPE  >38.8  AND 

SWEAT  <=150.5  AND  KI>  22.45 

0.60 

IF  SSI  <=5.21  AND  CAPE  >38.8  AND 

SWEAT  >  150.5 

0.69 

IF  SWEAT  >  80.5  AND  CAPE  <=  147  AND 

KI<=  21.55  AND  SSI  >5.21  AND  SSI  <=17.23 

AND  LI  >6.75  AND  LI  <=9.15 

0.41 

IF  SWEAT  >  80.5  AND  CAPE  <=  147  AND 

KI>  21.55  AND  SSI  >  6.25 

0.63 

IF  SSI  >5.21  AND  SWEAT  >  80.5  AND  CAPE  >147 

0.70 

Tables  B-33  through  B-36  are  the  foreeast  rules  and  probabilities  for  Minot  Air 
Foree  Base,  North  Dakota.  Mount  Glasgow  International  Airport  (727680)  was  the  upper 
air  site  matehed  with  Minot.  The  following  CG  lightning  predietors  were  determined  to 
produee  the  best  sueeess  rate  for  Minot;  1)  Lifted  Index  (LI),  2)  Showalters  Stability 
Index  (SSI),  3)  Total  Totals  Index  (TTI)  4)  K  Index  (KI),  5)  Month,  6)  Conveetive 
Available  Potential  Energy  (CAPE),  7)  Severe  Weather  Threat  Index  (SWEAT),  8) 
Surfaee  pressure  at  Mt  Glasgow  Inti  Airport  (PRESS  UA),  and  9)  3  hour  surfaee 
pressure  ehange  at  Minot  matehing  the  sounding  time  (PRESC3). 
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Table  B-33.  Rules  to  predict  CG  lightning  for  Minot  within  10  nm  (cost  one  to 
one). 


Rules  to  Forecast  CG  lightning 

Probability  of 
correctly  predicting 
CG  lightning 

IF  MONTH  =  6,  7,  OR  8  AND  PRESS  UA  <=  934.5 
AND  KI<=  16.35  AND  CAPE  >  0.5  AND 
CAPE<=  1049.1 

0.69 

IF  MONTH  =  5,  6,  7,  8,  OR  9  AND  KI  >21.85  AND 

El  <=-0.55  AND  TTI>47.7 

0.82 

IF  MONTH  =  5,  6,  7,  8,  OR  9  AND  El  >  -0.55  AND 

El  <=2.75  AND  KI>  21.85  AND  KI<=  25.95  AND 
CAPE  <=154.9  AND  PRESS  UA<=  936.5  AND 
TTI<=51.4  AND  SWEAT  <=  74 

0.89 

IF  MONTH  =  5,  6,  7,  8,  OR  9  AND  El  >  -0.55  AND 

El  <=2.75  AND  KI>  21.85  AND  KI<=  25.95  AND 
CAPE  <=154.9  AND  PRESS  UA<=  936.5  AND 
TTI<=51.4  AND  SWEAT  >  97.5 

0.73 

IF  MONTH  =  5,  6,  7,  8,  OR  9  AND  El  >  -0.55  AND 

El  <=2.75  AND  KI>  25.95  AND  SWEAT  >  64.5 
AND  PRESS_UA<=931.05  AND  TTI  <=  53.9 

0.77 

IF  MONTH  =  5,  6,  OR  7  AND  El  >  -0.55  AND 

El  <=2.75  AND  KI>  25.95  AND  SWEAT  >  64.5 
AND  PRESS  UA>  931.05  AND  SSI  > -0.92  AND 

SSI  <=  0.02 

0.89 

IF  MONTH  =  5,  6,  OR  7  AND  KI  >  25.95  AND 
SWEAT  >64.5  AND  PRESS  UA>  931.05  AND 

SSI  >0.76  AND  El  >0.65  AND  El  <=2.75 

0.77 

IF  MONTH  =  5,  6,  7,  OR  8  AND  KI>  21.85  AND 

El  >2.75  AND  PRESS  UA<=  931.5  AND 
SWEAT  <=  190 

0.75 

102 


Table  B-34.  Rules  to  predict  CG  lightning  for  Minot  within  10  nm  (cost  two  to 
one). 


Rules  to  Forecast  CG  lightning 

Probability  of 
correctly  predicting 
CG  lightning 

IF  MONTH  =  7  AND  KI<=  21.85  AND 

SWEAT  <=75.5 

0.66 

IF  MONTH  =  5  OR  9  AND  KI<=  21.85  AND 

LI  <=11.85  AND  SWEAT  >75.5  AND 

SWEAT  <=  146  AND  TTI  <=  47.7  AND 

SSI  >-1.17  AND  SSI  <=7.15 

0.41 

IF  MONTH  =  6,  7,  OR  8  &  KI<=  21.85 

AND  SWEAT  >75.5  AND  SSI  >-1.17  AND 

LI  <=11.85  AND  TTI  <=38.5 

0.60 

IF  MONTH  =  6,  7,  OR  8  AND  KI<=  21.85 

AND  SWEAT  >75.5  AND  SSI  >-1.17  AND 

TTI  >38.5  AND  TTI  <=50.3  AND  LI  <=4.55 

0.50 

IF  MONTH  =  5,  6,  7,  8  OR  9  AND  KI>  21.85  AND 

LI  <=  3.05 

0.74 

IF  MONTH  =  5,  6,  7,  OR  8  AND  KI>  21.85  AND 

LI  >3.05  AND  SWEAT  <=189.5 

0.58 
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Table  B-35.  Rules  to  predict  CG  lightning  for  Minot  within  25  nm  (cost  one  to 
one). 


Rules  to  Forecast  CG  lightning 

Probability  of 
correctly  predicting 
CG  lightning 

IF  MONTH  =  3,  4,  OR  5  AND  LI  <=  2.75  AND 

KI  >  28.35 

0.72 

IF  MONTH  =  6,  7,  8,  or  9  AND  LI  <=  2.75 

0.75 

IF  MONTH  =  6,  7,  OR  8  AND  LI  >  2.75  AND 
PRESS_UA<=  931.5  AND  SWEAT  <=167.5 

0.65 

IF  MONTH  =  7,  OR  8  AND  LI  >  2.75  AND 

PRESS  UA>  931.5  AND  PRESS  UA  <=  936.5  AND 
KO<=5.15  AND  TTI>4L5  AND  PRESC3<=-0.1 
AND  CAPE  >0.5  AND  SWEAT  <=114.5 

0.81 

IF  MONTH  =  6,  7,  OR  8  AND  El  >  2.75  AND 
PRESS  UA>  931.5  AND  PRESS  UA  <=  936.5  AND 
KO>5.15 

0.56 
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Table  B-36.  Rules  to  predict  CG  lightning  for  Minot  within  25  nm  (cost  two  to 
one). 


Rules  to  Forecast  CG  lightning 

Probability  of 
correctly  predicting 
CG  lightning 

IF  MONTH  =  5,  6,  7,  8,  OR  9  AND  LI  <=  2.35 

0.74 

IF  MONTH  =  5,  7,  OR  8  AND  LI  >  2.35  AND 

LI  <=4.25  AND  KI<=19.7  AND  SSI  >2.14 

0.52 

IF  MONTH  =  5,  7,  8,  OR  9  AND  LI  >  2.35  AND 

LI  <=4.25  AND  KI>  21.95  AND  KI  <=  30.35  AND 
SWEAT  <=  167.5 

0.57 

IF  MONTH  =  6  AND  LI  >2.35  AND  LI  <=  4.25 
AND  KI>  21.95  AND  SWEAT  <=206 

0.81 

IF  MONTH  =  5  OR  8  AND  LI  >4.25  AND  KI>9.8 
AND  CAPE  <=1.1  AND  SWEAT  >106.5 

0.56 

IF  MONTH  =  6  OR  7  AND  CAPE  <=101.2  AND 

LI  >4.25  AND  LI  <=11.45  AND  KI>11.1  AND 
SWEAT  <=  62.5 

0.54 

IF  MONTH  =  6  OR  7  AND  CAPE  <=101.2  AND 

LI  >4.25  AND  LI  <=11.45  AND  SWEAT  >  72.5 
AND  SWEAT  <=  156.5  AND  TTI  <=  38.5 

0.71 

MONTH  =  6  OR  7  AND  CAPE  <=101.2  AND 

LI  >4.25  AND  LI  <=11.45  AND  SWEAT  >  72.5 
AND  SWEAT  <=156.5  AND  TTI  >  39.95 

0.59 

Tables  B-37  through  B-40  are  the  foreeast  rules  and  probabilities  for  Offutt  Air 
Foree  Base,  Nebraska.  NE  Omaha/Valley  (725580)  was  the  upper  air  site  matehed  with 
Offutt.  The  following  CG  lightning  predietors  were  determined  to  produee  the  best 
sueeess  rate  for  Offutt:  1)  Lifted  Index  (LI),  2)  Showalters  Stability  Index  (SSI),  3)  Total 
Totals  Index  (TTI)  4)  K  Index  (KI),  5)  Month,  6)  KO  Index  (KO),  7)  Severe  Weather 
Threat  Index  (SWEAT),  8)  Surfaee  pressure  at  Offutt  matehing  the  sounding  time 
(STAPRESS),  and  9)  Conveetive  Available  Potential  Energy  (CAPE). 
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Table  B-37.  Rules  to  predict  CG  lightning  for  Offutt  within  10  nm  (cost  one  to 
one). 


Rules  to  Forecast  CG  lightning 

Probability  of 
correctly  predicting 
CG  lightning 

IF  MONTH  =  4,  5,  6,  OR  7  AND  SSI  <=  4.75  AND 

KI  <=  30.55 

0.57 

IF  SSI  <=4.75  AND  KI  >  30.55 

0.71 

Table  B-38.  Rules  to  predict  CG  lightning  for  Offutt  within  10  nm  (cost  two  to 
one). 

Rules  to  Forecast  CG  lightning 

Probability  of 
correctly  predicting 
CG  lightning 

IF  MONTH  =  3,  8,  OR  9  AND  SSI  <=  4.75  AND 

KI  <=  30.55  AND  CAPE  >  77.6  AND 

SWEAT  <=  132.5 

0.65 

IF  MONTH  =  3,  8,  OR  9  AND  KI  <=  30.55 

AND  CAPE  >77.6  AND  SWEAT  >132.5 

AND  SSI  <=0.19 

0.50 

IF  MONTH  =  4,  5,  6,  OR  7  AND  SSI  <=  4.75  AND 

KI  <=  30.55 

0.57 

IF  SSI  <=4.75  AND  KI  >  30.55 

0.71 

IF  MONTH  =  4,  5,  6,  8,  OR  9  AND  SSI  >  4.75  AND 

KI  >  14.45  AND  TTI  <=  42.9  AND  El  >  6.05  AND 
SWEAT  >  73.5  AND  KO  >  10.35 

0.66 
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Table  B-39.  Rules  to  predict  CG  lightning  for  Offutt  within  25  nm  (cost  one  to 
one). 


Rules  to  Forecast  CG  lightning 

Probability  of 
correctly  predicting 
CG  lightning 

IF  KI>  18.45  AND  KI<=  33.45  AND  TTI<=57.3 
AND  KO<=  10.55  AND  SSI  <=-0.66 

0.67 

IF  KI>  18.45  AND  KI<=  33.45  AND  TTI<=57.3 
AND  SSI  >-0.59  AND  SSI  <=2.98  AND 

CAPE  >110.65  AND  STAPRESS  >  972.9  AND 

El  >-3.25  AND  KO>-14.5  AND  KO<=-1.85  AND 
SWEAT  >  125.5  AND  SWEAT  <=  276.5 

0.61 

IF  KI>  18.45  AND  KI<=  33.45  AND  TTI<=57.3 
AND  SSI  >-0.59  AND  SSI  <=2.98  AND  KO>-1.85 
AND  KO<=  10.55  AND  El  <=  0.75 

0.86 

IF  KI>  18.45  AND  KI<=  33.45  AND  SSI  > -0.59 
AND  SSI  <=2.98  AND  KO>-1.85  AND 

KO  <=  10.55  AND  El  >  0.75  AND  TTI  >  50.45  AND 
TTI  <=  57.3 

0.61 

IF  SSI  <=2.98  AND  KI>  18.45  AND  KI  <=  33.45 
AND  TTI  >57.3 

0.88 

IF  SSI  <=2.98  AND  KI  >  33.45 

0.82 

IF  MONTH  =  5,  6,  7,  OR  8  AND  KI  >  16.65  AND 
KI<=  28.15  AND  KO<=  11.15  AND  El  <=5.95 
AND  STAPRESS  >  973.9  AND  STAPRESS  <=  977.5 
AND  TTI  >39.1  AND  SSI  >  3.54  AND  SSI  <=5.66 

0.74 

IF  SSI  >2.98  AND  KI>  28.15  AND  TTI  <=42.75 

0.83 
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Table  B-40.  Rules  to  predict  CG  lightning  for  Offutt  within  25  nm  (cost  two  to 
one). 


Rules  to  Forecast  CG  lightning 

Probability  of 
correctly  predicting 
CG  lightning 

IF  SSI  <=-0.67  AND  KI  <=  30.35 

0.66 

IF  MONTH  =  3,  5,  OR  6  AND  KI  <=  17.85  AND 
CAPE  <=63.3  AND  KO>-5.05  AND  SSI  >2.16 
AND  SSI  <=4.40 

0.60 

IF  SSI  >-0.67  AND  SSI  <=4.40  AND  KI<=  17.85 
AND  KO>-8.85  AND  CAPE  >  63.3  AND 

CAPE  <=  256.3 

0.58 

IF  MONTH  =  4,  5,  6,  7,  8,  OR  9  AND  KI  >  18.4  AND 
KI<=  30.65  AND  KO  <=  8.35  AND  TTI  >44.55 
AND  SSI  >-0.59  AND  SSI  <=4.04  AND 

SWEAT  <=  323.5 

0.56 

IF  SSI  <=4.40  AND  KI  >  30.65 

0.76 

IF  LI  <=3.65  AND  TTI  <=41.5  AND  KI  >  8.25 

AND  KI<=  25.25  AND  SSI  >4.88 

0.64 

IF  MONTH  =  4,  5,  6,  7,  8,  OR  9  AND  CAPE  <=0.15 
AND  KI>  18.65  AND  SSI  >4.98  AND  KO  >  3.25 
AND  KO<=  10.35  AND  LI  >3.65  AND  LI  <=  9.65 
AND  TTI  >38.2  AND  TTI  <=42.1 

0.64 

IF  MONTH  =  5,  6,  8,  OR  9  AND  SSI  >  4.40  AND 
KI>8.25  AND  LI  >3.65  AND  KO>  10.35  AND 
SWEAT  >  88.5 

0.70 

Tables  B-41  through  B-44  are  the  foreeast  rules  and  probabilities  for  Seott  Air 
Foree  Base,  Illinois.  Peoria  Regional  Airport  (725320)  was  the  upper  air  site  matehed 
with  Scott.  The  following  CG  lightning  predictors  were  determined  to  produce  the  best 
success  rate  for  Scott:  1)  Lifted  Index  (LI),  2)  Showalters  Stability  Index  (SSI),  3)  Total 
Totals  Index  (TTI)  4)  K  Index  (KI),  5)  Month,  6)  KO  Index  (KO),  7)  Severe  Weather 
Threat  Index  (SWEAT),  8)  Surface  pressure  at  Peoria  Regional  Airport  matching  the 
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sounding  time  (PRESS_UA),  9)  Convective  Available  Potential  Energy  (CAPE),  and  10) 
Three  hour  surface  pressure  change  at  Scott  matching  the  sounding  time  (PRESC3). 


Table  B-41.  Rules  to  predict  CG  lightning  for  Scott  within  10  nm  (cost  one  to  one). 


Rules  to  Forecast  CG  lightning 

Probability  of 
correctly  predicting 
CG  lightning 

IF  SSI  <=1.65  AND  KI>4.45  AND  KI<=  26.25 

0.59 

IF  KI>4.45  AND  KI<=  26.95  AND  SSI  >1.65  AND 
KO<=3.15  AND  SWEAT  >62.5  AND 

SWEAT  <=103.5  AND  LI  >  -0.7  AND  LI  <=  4.65 

0.70 

IF  KO>3.15  AND  SWEAT  <=121.5  AND 

KI>  20.95  AND  KI  <=  26.95  AND  SSI  >4.77 

0.65 

IF  KI>4.45  AND  KI<=  26.95  AND  SSI  >1.65  AND 
KO>3.15  AND  SWEAT  >121.5  AND  TTI<=48.2 

0.56 

IF  KI>  26.95 

0.73 
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Table  B-42.  Rules  to  predict  CG  lightning  for  Scott  within  10  nm  (cost  two  to  one). 


Rules  to  Forecast  CG  lightning 

Probability  of 
correctly  predicting 
CG  lightning 

IF  SSI  <=3.61  AND  KI<=  28.85  AND  TTI>42.0 

0.43 

IF  MONTH  =  3,  4,  5,  6,  7,  OR  8  AND  SSI  <=  3.61 
AND  KI<=  28.85  AND  TTI>42.0  AND 

CAPE  >47.8  AND  CAPE  <=5106.7 

0.59 

IF  SSI  <=3.61  AND  KI>  28.85 

0.72 

IF  MONTH  =  4  OR  6  AND  SSI  >3.61  AND  El  >  7.25 
AND  KI>-4.2  AND  KI  <=  4.45  AND  KO  >  9.05 
AND  KO  <=14.9 

0.60 

IF  MONTH  =  3,  4,  5,  6,  7,  OR  8  AND  CAPE  <=  972.3 
AND  PRESC3>-1.8  AND  PRESC3  <=  1.55  AND 
PRESS  UA>  990.05  AND  SWEAT  >  30.5  AND 
SWEAT  <=175.5  AND  SSI  >3.61  AND  SSI  <=15.80 
AND  TTI>34.4  AND  TTI<=42.1  AND  KI>8.55 
AND  KI  <=  19.25 

0.51 

IF  MONTH  =  3,  4,  5,  6,  7,  OR  8  AND  SSI  >3.61  AND 
PRESC3>-1.8  AND  CAPE  <=  972.3  AND 
TTI<=42.8  AND  KI>  19.25  AND  SWEAT  <=  129.5 

0.76 

IF  MONTH  =  3,  4,  5,  6,  7,  OR  8  AND  SSI  >3.61  AND 
KI>4.45  AND  SWEAT  <=191.5  AND 

CAPE  <=972.3  AND  PRESC3>-1.8  AND 
PRESC3<=0.1  AND  TTI>44.0 

0.48 

IF  MONTH  =  3,  4,  5,  6,  7,  OR  8  AND  SSI  >3.61  AND 
KI>4.45  AND  PRESC3>-1.8  AND  SWEAT  >191.5 

0.70 
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Table  B-43.  Rules  to  predict  CG  lightning  for  Scott  within  25  nm  (cost  one  to  one). 


Rules  to  Forecast  CG  lightning 

Probability  of 
correctly  predicting 
CG  lightning 

IF  LI  <=5.65  AND  KI>14.6  AND  KI<=  20.45 

AND  SSI  <=2.71  AND  CAPE  >475.0  AND 
TTI>42.9  AND  TTI<=47.3 

0.58 

IF  KI<=  20.45  AND  LI  <=5.65  AND  SSI  <=3.67 
AND  TTI>47.3  AND  TTI<=49.5 

0.76 

IF  KI>  20.45  AND  KI  <=  29.05  AND  SSI  <=  2.04 
AND  SWEAT  <=250.5 

0.67 

IF  KI>  20.45  AND  KI  <=  29.05  AND  SSI  <=  2.04 
AND  SWEAT  >298 

0.77 

IF  KI>  20.45  AND  KI<=  29.05  AND  TTI  <=  47.8 
AND  SSI  >2.04  AND  SSI  <=4.59  AND  LI  <=4.45 
AND  CAPE  >85.5  AND  CAPE  <=227.4 

0.61 

IF  KI>  20.45  AND  KI<=  29.05  AND  CAPE  <=40.4 
AND  LI  >5 

0.62 

IF  KI  >  29.05  AND  SWEAT  >  124.5  AND 

CAPE  <=82.45  AND  TTI  <=  49.5 

0.79 

KI>  29.05  AND  SWEAT  >124.5  AND  CAPE  >102.1 
AND  CAPE  <=252.8  AND  SSI  <=1.60 

0.81 

KI>  29.05  AND  CAPE  >263.7 

0.72 
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Table  B-44.  Rules  to  predict  CG  lightning  for  Scott  within  25  nm  (cost  two  to  one). 


Rules  to  Forecast  CG  lightning 

Probability  of 
correctly  predicting 
CG  lightning 

IF  KI<=  20.45  AND  SSI  <=  3.67  AND 

CAPE  <=4828.4  AND  &  LI  <=-1.75 

0.64 

IF  SSI  >  3.67  AND  TTI  >  30.4  AND  KI  >  6.2  AND 
KI<=  20.45  AND  LI  >-1.35  AND  LI  <=  5.05  AND 
SWEAT  >67.5  AND  SWEAT  <=103 

0.61 

IF  KI  >  -7.35  AND  KI  <=  13.25  AND  TTI  <=  33.5 
AND  LI  >5.65  ANDLI<=  11.85  AND  SWEAT  >53.5 
AND  SWEAT  <=127.5 

0.53 

IF  SWEAT  <=193  AND  KI>  13.25  AND 

KI<=  20.45  AND  TTI  <=42.05  AND  LI  >12.45 

0.62 

IF  KI>  20.45  AND  KI  <=  29.05  AND  SSI  <=  2.04 
AND  TTI  >41.5  AND  SWEAT  >146  AND 

CAPE  >53.1 

0.70 

IF  KI>  20.45  AND  KI<=  29.05  AND  SSI  >2.04 
AND  SSI  <=4.89  AND  TTI  >42.2  AND  TTI  <=48.2 
AND  CAPE  <=51.2  AND  SWEAT  >83.5  AND 

LI  >3  AND  LI  <=  11.35 

0.62 

IF  KI>  20.45  AND  KI<=  29.05  AND  TTI  <=  48.2 
AND  SSI  >2.04  AND  SSI  <=4.89  AND  CAPE  >  85.5 
AND  CAPE  <=601.1  AND  LI  <=3.35  AND 
SWEAT  >  149 

0.69 

TTI  <=48.2  AND  SSI  >4.89  AND  KI>  20.45  AND 
KI<=  24.85  AND  CAPE  <=51.1  AND  LI  <=17.3 

0.58 

TTI  <=48.2  AND  SSI  >4.89  AND  KI>  24.85  AND 

KI  <=  29.05 

0.74 

KI>  29.05  AND  SWEAT  >124.5  AND 

CAPE  <=252.8 

0.74 

KI>  29.05  AND  CAPE  >263.7 

0.72 

Tables  B-45  through  B-48  are  the  foreeast  rules  and  probabilities  for  Westover 
Air  Foree  Base,  Massaehusetts.  Albany  County  Airport  (725180)  was  the  upper  air  site 
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matched  with  Westover.  The  following  CG  lightning  predictors  were  determined  to 
produce  the  best  suceess  rate  for  Westover:  1)  Showalters  Stability  Index  (SSI),  2)  Lifted 
Index  (LI),  3)  Total  Totals  Index  (TTI)  4)  K  Index  (KI),  5)  Conveetive  Available 
Potential  Energy  (CAPE),  and  6)  Severe  Weather  Threat  Index  (SWEAT). 


Table  B-45.  Rules  to  predict  CG  lightning  for  Westover  within  10  nm  (cost  one  to 
one). 


Rules  to  Forecast  CG  lightning 

Probability  of 
correctly  predicting 
CG  lightning 

IF  SSI  <=2.58  AND  LI  >-1.55  AND 

SWEAT  <=199.5  AND  KI>20.4  AND  KI<=  23.65 

0.67 

IF  SSI  <=2.58  AND  KI<=  23.65  AND  LI  >-1.55 
AND  SWEAT  >199.5 

0.71 

IF  SSI  <=2.58  AND  KI>  23.65 

0.75 

IF  KI>  17.85  AND  CAPE  >11.6  AND 

SWEAT  >125.5  AND  SSI  >3.09  AND  TTI  >  37.2 

0.62 
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Table  B-46.  Rules  to  predict  CG  lightning  for  Westover  within  10  nm  (cost  two  to 


one). 

Rules  to  Forecast  CG  lightning 

Probability  of 
correctly  predicting 
CG  lightning 

IF  SSI  <=2.58  AND  LI  >-1.55  AND  KI>  17.05 
AND  KI<=  23.65  AND  SWEAT  <=183.5 

0.61 

IF  SSI  <=2.58  AND  KI<=  23.65  AND  LI  >-1.55 
AND  SWEAT  >199.5  AND  CAPE  >  122.0 

0.78 

IF  SSI  <=2.58  AND  KI>  23.65 

0.75 

IF  TTI<=49.0  AND  KI  >  17.95  AND  SSI  >3.09 
AND  SSI  <=4.63  AND  SWEAT  >  72  AND 
SWEAT  <=  234  AND  LI  <=  1.65 

0.81 

IF  TTI<=49.0  AND  KI  >  17.95  AND  SSI  >3.09 
AND  SSI  <=4.63  AND  SWEAT  >  72  AND 
SWEAT  <=234  AND  LI  >4.75  AND  LI  <=  6.45 

0.85 

IF  SSI  >5.79  AND  SWEAT  >  77.5  AND  LI  <=8.15 
AND  KI>  23.55  AND  KI<=  25.65 

0.79 

Table  B-47.  Rules  to  predict  CG  lightning  for  Westover  within  25  nm  (cost  one  to 
one). 

Rules  to  Forecast  CG  lightning 

Probability  of 
correctly  predicting 
CG  lightning 

IF  SSI  <=4.43  AND  KI<=  24.15  AND  TTI>45.4 
AND  TTI<=50.7  AND  SWEAT  >  87.5 

0.64 

IF  KI>  24.15  AND  CAPE  <=182.3  AND 

SSI  <=2.60  AND  SWEAT  >164.5 

0.77 

IF  KI>  24.15  AND  CAPE  <=182.3  AND  SSI  >2.60 
AND  SSI  <=4.43  AND  LI  >4.25  AND  LI<=7 

0.68 

IF  SSI  <=4.43  AND  KI>  24.15  AND  CAPE  >182.3 

0.77 

IF  KO>2.85  AND  SSI  >4.43  AND  SSI  <=14.05 
AND  KI>  17.85  AND  CAPE  >11.3  AND 

CAPE  <=64.9  AND  TTI<=39.7 

0.67 

IF  KI>  11.55  AND  CAPE  >178  AND  SSI  >4.43 
AND  SSI  <=6.33 

0.62 
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Table  B-48.  Rules  to  predict  CG  lightning  for  Westover  within  25  nm  (cost  two  to 
one). 


Rules  to  Forecast  CG  lightning 

Probability  of 
correctly  predicting 
CG  lightning 

IF  KI<=  20.45  AND  SSI  <=  3.67  AND 

CAPE  <=4828.4  AND  LI  <=-1.75 

0.61 

IF  SSI  >  3.67  AND  TTI  >  30.4  AND  KI  >  6.2  AND 
KI<=  20.45  AND  LI  >-1.35  AND&  LI  <=  5.05  AND 
SWEAT  >67.5  AND  SWEAT  <=  103 

0.64 

IF  KI  >  -7.35  AND  KI  <=  13.25  AND  TTI  <=  33.5 
AND  LI  >5.65  AND  LI  <=11.85  AND 

SWEAT  >53.5  AND  SWEAT  <=127.5 

0.67 

IF  SWEAT  <=193  AND  KI>  13.25  AND 

KI<=  20.45  AND  TTI  <=42.05  AND  LI  >12.45 

0.77 

IF  KI>  20.45  AND  KI  <=  29.05  AND  SSI  <=  2.04 
AND  TTI  >41.5  AND  SWEAT  >146  AND 

CAPE  >53.1 

0.58 

IF  KI>  20.45  AND  KI<=  29.05  AND  SSI  >2.04 
AND  SSI  <=4.89  AND  TTI  >42.2  AND  TTI  <=48.2 
AND  CAPE  <=51.2  AND  SWEAT  >  83.5  AND 

LI  >3  AND  LI  <=  11.35 

0.73 

IF  KI>  20.45  AND  KI<=  29.05  AND  TTI  <=48.2 
AND  SSI  >2.04  AND  SSI  <=4.89  AND  CAPE  >  85.5 
AND  CAPE  <=601.1  AND  LI  <=3.35  AND 
SWEAT  >  149 

0.62 

Tables  B-49  through  B-52  are  the  forecast  rules  and  probabilities  for  Wright 
Patterson  Air  Force  Base,  Ohio.  Wilmington  (724260)  was  the  upper  air  site  matched 
with  WPAFB.  The  following  CG  lightning  predictors  were  determined  to  produce  the 
best  success  rate  for  WPAFB;  1)  Showalters  Stability  Index  (SSI),  2)  Surface  temperature 
at  WPAFB  matching  the  sounding  time  (TEMPC),  3)  Surface  pressure  at  WPAFB 
(STAPRESS),  and  4)  K  Index  (KI). 
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Table  B-49.  Rules  to  prediet  CG  lightning  for  Wright  Patterson  within  10  nm  (eost 
one  to  one) 


Rules  to  Forecast  CG  lightning 

Probability  of 
correctly  predicting 
CG  lightning 

IF  SSI  <=1.11  AND  TEMPC>8.9 

0.75 

IF  SSI  >1.11  AND  SSI  <=3.13  AND 
TEMPC  <=  24.7 

0.58 

Table  B-50. 
two  to  one) 

Rules  to  prediet  CG  lightning  for  Wright  Patterson  within  10  nm  (eost 

Rules  to  Forecast  CG  lightning 

Probability  of 
correctly  predicting 
CG  lightning 

IF  SSI  <=3.13 

0.69 

IF  SSI  >3.13  AND 

STAPRESS  <=  987.4  AND  KI  >16.85 

0.43 

Table  B-51.  Rules  to  prediet  CG  lightning  for  Wright  Patterson  within  25  nm 
(eost  one  to  one) 

Rules  to  Forecast  CG  lightning 

Probability  of 
correctly  predicting 
CG  lightning 

IF  SSI  <=0.63 

0.77 

IF  SSI  >0.63  AND  SSI  <=  3.22  AND  KI<=  29.35 
AND  STAPRESS  <=984.1 

0.61 

IF  SSI  >0.63  AND  SSI  <=3.22  AND  KI>  29.35 

0.69 
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Table  B-52.  Rules  to  predict  CG  lightning  for  Wright  Patterson  within  25  nm 
(cost  two  to  one) 


Rules  to  Forecast  CG  lightning 

Probability  of 
correctly  predicting 
CG  lightning 

IF  SSI  <=4.18 

0.68 

IF  SSI  >4.18  AND  KI  >  12  AND 
STAPRESS  <=  987.4  AND  TEMPC  >  9.7 

0.44 
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